Aug 26 16:58:50 devstack cinder-volume[83046]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 26 16:58:50 devstack cinder-volume[83046]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 26 16:58:50 devstack cinder-volume[83046]: we strongly recommend against using it for new projects.
Aug 26 16:58:50 devstack cinder-volume[83046]: If you are already using Eventlet, we recommend migrating to a different
Aug 26 16:58:50 devstack cinder-volume[83046]: framework.  For more detail see
Aug 26 16:58:50 devstack cinder-volume[83046]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 26 16:58:50 devstack cinder-volume[83046]:   import eventlet  # noqa
Aug 26 16:58:52 devstack cinder-volume[83046]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 16:58:52 devstack cinder-volume[83046]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 16:58:52 devstack cinder-volume[83046]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 16:58:54 devstack cinder-volume[83046]: INFO dbcounter [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Registered counter for database cinder
Aug 26 16:58:54 devstack cinder-volume[83046]: DEBUG oslo_db.sqlalchemy.engines [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 16:58:54 devstack cinder-volume[83046]: DEBUG dbcounter [-] [83046] Writer thread running {{(pid=83046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 26 16:58:54 devstack cinder-volume[83046]: INFO cinder.rpc [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 26 16:58:54 devstack cinder-volume[83046]: INFO cinder.rpc [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 26 16:58:54 devstack cinder-volume[83046]: DEBUG oslo_db.sqlalchemy.engines [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 16:58:54 devstack cinder-volume[83046]: INFO cinder.volume.manager [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Determined volume DB was empty at startup.
Aug 26 16:58:54 devstack cinder-volume[83046]: DEBUG cinder.volume.manager [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83046) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 26 16:58:54 devstack cinder-volume[83046]: INFO cinder.volume.manager [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Service not found for updating active_backend_id, assuming default for driver init.
Aug 26 16:58:54 devstack cinder-volume[83046]: WARNING stevedore.named [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 26 16:58:54 devstack cinder-volume[83046]: WARNING castellan.key_manager [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 16:58:54 devstack cinder-volume[83046]: WARNING cinder.keymgr.conf_key_mgr [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 16:58:54 devstack cinder-volume[83046]: DEBUG cinder.volume.drivers.lvm [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83046) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Aug 26 16:58:54 devstack cinder-volume[83046]: DEBUG oslo_concurrency.processutils [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_concurrency.processutils [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] CMD "cinder-rtstool verify" returned: 0 in 0.415s {{(pid=83046) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_db.sqlalchemy.engines [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 16:58:55 devstack cinder-volume[83046]: INFO cinder.rpc [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Aug 26 16:58:55 devstack cinder-volume[83046]: INFO cinder.rpc [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Aug 26 16:58:55 devstack cinder-volume[83046]: WARNING stevedore.named [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 26 16:58:55 devstack cinder-volume[83046]: WARNING castellan.key_manager [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 16:58:55 devstack cinder-volume[83046]: INFO cinder.volume.manager [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_db.sqlalchemy.engines [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 16:58:55 devstack cinder-volume[83046]: INFO oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Starting 1 workers
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Started child 83199 {{(pid=83046) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Full set of CONF: {{(pid=83046) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] ******************************************************************************** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Configuration options gathered from: {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] ================================================================================ {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] allow_availability_zone_fallback = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83199]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] allow_compression_on_image_upload = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] allowed_direct_url_schemes     = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] api_rate_limit                 = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] auth_strategy                  = keystone {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] az_cache_duration              = 3600 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_availability_zone      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_host                   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_name                   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_stats_polling_interval = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backup_api_class               = cinder.backup.api.API {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backup_name_template           = backup-%s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backup_use_same_host           = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backup_use_temp_snapshot       = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] chap_password                  = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] chap_username                  =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cinder_internal_tenant_project_id = b09f32110b2a4e818bbb23daa8dd5628 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cinder_internal_tenant_user_id = cb97d0463cb7406595aeafb3658b9de4 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cloned_volume_same_az          = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cluster                        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] compression_format             = gzip {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] config_dir                     = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] config_source                  = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] control_exchange               = openstack {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] debug                          = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] default_availability_zone      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] default_group_type             = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] default_volume_type            = lvmdriver-1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] disk_geometry                  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] driver_client_cert             = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] driver_client_cert_key         = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] driver_data_namespace          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] driver_ssl_cert_path           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] driver_ssl_cert_verify         = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] driver_use_ssl                 = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] enable_force_upload            = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] enable_new_services            = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] enable_unsupported_driver      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] enforce_multipath_for_image_xfer = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] filter_function                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance_api_insecure            = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance_api_servers             = ['http://192.168.122.93/image'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance_api_ssl_compression     = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance_ca_certificates_file    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance_certfile                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance_keyfile                 = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance_num_retries             = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance_request_timeout         = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] goodness_function              = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] graceful_shutdown_timeout      = 5 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] group_api_class                = cinder.group.api.API {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] host                           = devstack {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] image_compress_on_upload       = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] image_conversion_address_space_limit = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] image_conversion_cpu_limit     = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] image_conversion_disable       = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] image_upload_use_cinder_backend = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] image_upload_use_internal_tenant = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] image_volume_cache_enabled     = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] image_volume_cache_max_count   = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] image_volume_cache_max_size_gb = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] init_host_max_objects_retrieval = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] iscsi_target_flags             =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] iscsi_write_cache              = on {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] iser_helper                    = tgtadm {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] iser_ip_address                = 192.168.122.93 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] iser_port                      = 3260 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] log_color                      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] log_config_append              = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] log_dir                        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] log_file                       = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] log_options                    = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] log_rotate_interval            = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] log_rotate_interval_type       = days {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] log_rotation_type              = none {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] max_age                        = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] max_logfile_count              = 30 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] max_logfile_size_mb            = 200 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] max_over_subscription_ratio    = 20.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] message_reap_interval          = 86400 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] message_ttl                    = 2592000 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] migration_create_volume_timeout_secs = 300 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] monkey_patch                   = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] monkey_patch_modules           = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] my_ip                          = 192.168.122.93 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] no_snapshot_gb_quota           = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] num_iser_scan_tries            = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] num_shell_tries                = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] num_volume_device_scan_tries   = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] nvmeof_conn_info_version       = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] nvmet_ns_id                    = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83199]: INFO cinder.volume.manager [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Aug 26 16:58:55 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] nvmet_port_id                  = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] osapi_max_limit                = 1000 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] osapi_volume_ext_list          = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] osapi_volume_listen_port       = 8776 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] osapi_volume_use_ssl           = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] osapi_volume_workers           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] per_volume_size_limit          = -1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] periodic_fuzzy_delay           = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] periodic_interval              = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] public_endpoint                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] publish_errors                 = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] quota_backup_gigabytes         = 1000 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] quota_backups                  = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] quota_gigabytes                = 1000 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] quota_groups                   = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] quota_snapshots                = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] quota_volumes                  = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] rate_limit_burst               = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] rate_limit_except_level        = CRITICAL {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] rate_limit_interval            = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] reinit_driver_count            = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] replication_device             = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] report_discard_supported       = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] report_interval                = 120 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] reservation_clean_interval     = 86400 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] reservation_expire             = 86400 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] reserved_image_namespaces      = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] reserved_percentage            = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] rpc_response_timeout           = 120 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] run_external_periodic_tasks    = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] scst_target_driver             = iscsi {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] scst_target_iqn_name           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] service_down_time              = 720 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] shell_completion               = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] snapshot_name_template         = snapshot-%s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] snapshot_same_host             = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] split_loggers                  = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] state_path                     = /opt/stack/data/cinder {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] storage_availability_zone      = nova {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] storage_protocol               = iSCSI {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] syslog_log_facility            = LOG_USER {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] target_helper                  = lioadm {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] target_ip_address              = 192.168.122.93 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] target_port                    = 3260 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] target_protocol                = iscsi {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] target_secondary_ip_addresses  = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] trace_flags                    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] transport_url                  = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] until_refresh                  = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] use_chap_auth                  = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] use_default_quota_class        = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] use_journal                    = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] use_json                       = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] use_multipath_for_image_xfer   = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] use_stderr                     = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] use_syslog                     = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] verify_glance_signatures       = enabled {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volume_api_class               = cinder.volume.api.API {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volume_backend_name            = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volume_clear                   = zero {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volume_clear_ionice            = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volume_clear_size              = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volume_copy_bps_limit          = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volume_dd_blocksize            = 1M {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:55 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volume_name_template           = volume-%s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volume_service_inithost_offload = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volume_usage_audit_period      = month {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] zoning_mode                    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_concurrency.disable_process_locking = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.auth_section = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.auth_type   = password {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.auth_version = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.cache       = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.certfile    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.include_service_catalog = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.insecure    = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.interface   = public {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.keyfile     = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_password = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcache_username = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.region_name = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.service_token_roles_required = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.service_type = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.93/identity {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.backend                  = dogpile.cache.null {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.backend_argument         = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.backend_expiration_time  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.config_prefix            = cache.oslo {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.debug_cache_backend      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.enable_retry_client      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.enable_socket_keepalive  = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.enabled                  = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.expiration_time          = 600 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.hashclient_retry_attempts = 2 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.memcache_dead_retry      = 300 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:55 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.memcache_sasl_enabled    = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.password                 = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.proxies                  = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.redis_db                 = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.redis_server             = localhost:6379 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.retry_attempts           = 2 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.retry_delay              = 0.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.socket_keepalive_count   = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.socket_keepalive_idle    = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.socket_keepalive_interval = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.socket_timeout           = 1.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.tls_allowed_ciphers      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.tls_cafile               = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.tls_certfile             = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.tls_enabled              = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.tls_keyfile              = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cache.username                 = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] coordination.backend_url       = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.asyncio_connection    = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.asyncio_slave_connection = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.backend               = sqlalchemy {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.connection            = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.connection_debug      = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.connection_parameters =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.connection_recycle_time = 3600 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.connection_trace      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.db_inc_retry_interval = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.db_max_retries        = 20 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.db_max_retry_interval = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.db_retry_interval     = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.max_overflow          = 50 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.max_pool_size         = 5 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.max_retries           = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.mysql_wsrep_sync_wait = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.pool_timeout          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.retry_interval        = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.slave_connection      = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.sqlite_synchronous    = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.synchronous_reader    = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] database.use_db_reconnect      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler.connection_string     = messaging:// {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler.enabled               = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler.es_doc_type           = notification {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler.es_scroll_size        = 10000 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack sudo[83206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler.es_scroll_time        = 2m {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler.filter_error_trace    = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler.hmac_keys             = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack sudo[83206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler.sentinel_service_name = mymaster {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler.socket_timeout        = 0.1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler.trace_requests        = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler.trace_sqlalchemy      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler_jaeger.process_tags   = {} {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler_jaeger.service_name_prefix = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] profiler_otlp.service_name_prefix = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_policy.enforce_new_defaults = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_policy.policy_default_rule = default {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] privsep_osbrick.group          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] privsep_osbrick.helper_command = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] privsep_osbrick.user           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cinder_sys_admin.group         = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cinder_sys_admin.helper_command = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] cinder_sys_admin.user          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] service_user.auth_section      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] service_user.auth_type         = password {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] service_user.cafile            = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] service_user.certfile          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] service_user.collect_timing    = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] service_user.insecure          = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] service_user.keyfile           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] service_user.send_service_user_token = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] service_user.split_loggers     = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] service_user.timeout           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance.auth_section            = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance.auth_type               = password {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance.certfile                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance.collect_timing          = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance.insecure                = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance.keyfile                 = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance.region_name             = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance.split_loggers           = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] glance.timeout                 = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.backend_availability_zone = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.chap_password = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.chap_username =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.disk_geometry = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.driver_client_cert = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.driver_client_cert_key = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.driver_data_namespace = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.driver_use_ssl = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.extra_capabilities = {} {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.filter_function = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.goodness_function = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.iscsi_target_flags =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.iscsi_write_cache = on {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.iser_ip_address = 192.168.122.93 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.iser_port     = 3260 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.lvm_share_target = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.lvm_type      = auto {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.num_shell_tries = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.replication_device = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.report_discard_supported = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.reserved_percentage = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.target_helper = tgtadm {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.target_ip_address = 192.168.122.93 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.target_port   = 3260 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.target_protocol = iscsi {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.trace_flags   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.unique_fqdn_network = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.use_chap_auth = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.volume_backend_name = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.volume_clear  = zero {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.volume_clear_ionice = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.volume_clear_size = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_reports.file_event_handler = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_reports.log_dir           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.backend_availability_zone = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.backend_host       = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.chap_password      = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.chap_username      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.disk_geometry      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.driver_client_cert = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.driver_data_namespace = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.extra_capabilities = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.filter_function    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.goodness_function  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.iser_helper        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.iser_ip_address    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.iser_port          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.iser_target_prefix = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.lvm_share_target   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.lvm_type           = auto {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.num_shell_tries    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.replication_device = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.report_discard_supported = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.reserved_percentage = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.scst_target_driver = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.storage_protocol   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.target_helper      = lioadm {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.target_ip_address  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.target_port        = 3260 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.trace_flags        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.use_chap_auth      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.volume_clear       = zero {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.volume_clear_size  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] lvmdriver-1.volumes_dir        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_notifications.driver = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_notifications.retry = -1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] key_manager.fixed_key          = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.barbican_api_version  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.barbican_endpoint     = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.barbican_endpoint_type = public {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.barbican_region_name  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.cafile                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.certfile              = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.collect_timing        = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.insecure              = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.keyfile               = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.number_of_retries     = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.retry_delay           = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.send_service_user_token = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.split_loggers         = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.timeout               = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.verify_ssl            = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican.verify_ssl_path       = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican_service_user.auth_section = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican_service_user.auth_type = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican_service_user.cafile   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican_service_user.certfile = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican_service_user.collect_timing = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican_service_user.insecure = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican_service_user.keyfile  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican_service_user.split_loggers = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] barbican_service_user.timeout  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.approle_role_id          = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.approle_secret_id        = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.auth_method              = approle {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.auth_path                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.kv_mountpoint            = secret {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.kv_path                  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.kv_version               = 2 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.namespace                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.root_token_id            = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.ssl_ca_crt_file          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.timeout                  = 60.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.token_file               = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.token_role               = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.use_ssl                  = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 16:58:55 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] ******************************************************************************** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Aug 26 16:58:55 devstack sudo[83206]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:55 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:55 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:55 devstack sudo[83210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 16:58:55 devstack sudo[83210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:56 devstack sudo[83210]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:56 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.285s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:56 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 16:58:56 devstack cinder-volume[83199]: INFO cinder.brick.local_dev.lvm [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Aug 26 16:58:56 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:56 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:56 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:56 devstack sudo[83215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 16:58:56 devstack sudo[83215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:56 devstack sudo[83215]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:56 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:56 devstack cinder-volume[83199]: DEBUG cinder.brick.local_dev.lvm [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83199) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Aug 26 16:58:56 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:56 devstack sudo[83278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 16:58:56 devstack sudo[83278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:57 devstack sudo[83278]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:57 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.596s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:57 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:57 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:57 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:57 devstack sudo[83500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 16:58:57 devstack sudo[83500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:57 devstack sudo[83500]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:57 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:57 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:57 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:57 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:57 devstack sudo[83592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Aug 26 16:58:57 devstack sudo[83592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:57 devstack sudo[83592]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:57 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.288s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:57 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:57 devstack sudo[83680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 16:58:57 devstack sudo[83680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:57 devstack sudo[83680]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:57 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:57 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:57 devstack sudo[83756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 16:58:57 devstack sudo[83756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:58 devstack sudo[83756]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:58 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:58 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:58 devstack sudo[83824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 16:58:58 devstack sudo[83824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:58 devstack sudo[83824]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:58 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:58 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:58 devstack sudo[83833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 16:58:58 devstack sudo[83833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:58 devstack sudo[83833]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:58 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:58 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:58 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:58 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:58 devstack sudo[83912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 16:58:58 devstack sudo[83912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:59 devstack sudo[83912]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:59 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:59 devstack cinder-volume[83199]: INFO cinder.volume.drivers.lvm [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Aug 26 16:58:59 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:59 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:59 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:59 devstack sudo[83928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 16:58:59 devstack sudo[83928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:59 devstack sudo[83928]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:59 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.346s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:59 devstack cinder-volume[83199]: DEBUG cinder.volume.drivers.lvm [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Updating volume stats {{(pid=83199) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 16:58:59 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:59 devstack sudo[84011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 16:58:59 devstack sudo[84011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:58:59 devstack sudo[84011]: pam_unix(sudo:session): session closed for user root
Aug 26 16:58:59 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:58:59 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:58:59 devstack sudo[84014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 16:58:59 devstack sudo[84014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:59:00 devstack sudo[84014]: pam_unix(sudo:session): session closed for user root
Aug 26 16:59:00 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:59:00 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:59:00 devstack sudo[84017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 16:59:00 devstack sudo[84017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:59:00 devstack sudo[84017]: pam_unix(sudo:session): session closed for user root
Aug 26 16:59:00 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:59:00 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:59:00 devstack sudo[84020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 16:59:00 devstack sudo[84020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:59:00 devstack sudo[84020]: pam_unix(sudo:session): session closed for user root
Aug 26 16:59:00 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:59:00 devstack cinder-volume[83199]: INFO cinder.volume.driver [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Driver hasn't implemented _init_vendor_properties()
Aug 26 16:59:00 devstack cinder-volume[83199]: DEBUG cinder.volume.driver [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83199) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 26 16:59:00 devstack cinder-volume[83199]: DEBUG oslo_db.sqlalchemy.engines [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 16:59:00 devstack cinder-volume[83199]: DEBUG dbcounter [-] [83199] Writer thread running {{(pid=83199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 26 16:59:00 devstack cinder-volume[83199]: DEBUG cinder.db.api [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Building query based on filter {{(pid=83199) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 26 16:59:00 devstack cinder-volume[83199]: DEBUG cinder.image.image_utils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83199) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 26 16:59:00 devstack cinder-volume[83199]: INFO cinder.keymgr.migration [None req-4c20acf6-69c9-49ae-a7b3-a4549083da89 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 26 16:59:00 devstack cinder-volume[83199]: DEBUG cinder.volume.drivers.lvm [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Updating volume stats {{(pid=83199) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 16:59:00 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:59:00 devstack sudo[84024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 16:59:00 devstack sudo[84024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:59:01 devstack sudo[84024]: pam_unix(sudo:session): session closed for user root
Aug 26 16:59:01 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:59:01 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:59:01 devstack sudo[84027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 16:59:01 devstack sudo[84027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:59:01 devstack sudo[84027]: pam_unix(sudo:session): session closed for user root
Aug 26 16:59:01 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:59:01 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:59:01 devstack sudo[84032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 16:59:01 devstack sudo[84032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:59:01 devstack sudo[84032]: pam_unix(sudo:session): session closed for user root
Aug 26 16:59:01 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:59:01 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:59:01 devstack sudo[84036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 16:59:01 devstack sudo[84036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:59:01 devstack sudo[84036]: pam_unix(sudo:session): session closed for user root
Aug 26 16:59:01 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:59:01 devstack cinder-volume[83199]: DEBUG cinder.manager [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Notifying Schedulers of capabilities ... {{(pid=83199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 16:59:01 devstack cinder-volume[83199]: INFO cinder.volume.manager [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Driver initialization completed successfully.
Aug 26 16:59:01 devstack cinder-volume[83199]: INFO cinder.manager [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Initiating service 2 cleanup
Aug 26 16:59:02 devstack cinder-volume[83199]: INFO cinder.manager [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Service 2 cleanup completed.
Aug 26 16:59:02 devstack cinder-volume[83199]: DEBUG cinder.service [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Creating RPC server for service cinder-volume {{(pid=83199) start /opt/stack/cinder/cinder/service.py:231}}
Aug 26 16:59:02 devstack cinder-volume[83199]: DEBUG cinder.service [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83199) start /opt/stack/cinder/cinder/service.py:237}}
Aug 26 16:59:02 devstack cinder-volume[83199]: INFO cinder.volume.manager [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Aug 26 16:59:02 devstack cinder-volume[83199]: DEBUG cinder.volume.drivers.lvm [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Updating volume stats {{(pid=83199) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 16:59:02 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:59:02 devstack sudo[84075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 16:59:02 devstack sudo[84075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:59:02 devstack sudo[84075]: pam_unix(sudo:session): session closed for user root
Aug 26 16:59:02 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:59:02 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:59:02 devstack sudo[84080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 16:59:02 devstack sudo[84080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:59:02 devstack sudo[84080]: pam_unix(sudo:session): session closed for user root
Aug 26 16:59:02 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.232s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:59:02 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:59:02 devstack sudo[84086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 16:59:02 devstack sudo[84086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:59:03 devstack sudo[84086]: pam_unix(sudo:session): session closed for user root
Aug 26 16:59:03 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:59:03 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 16:59:03 devstack sudo[84089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 16:59:03 devstack sudo[84089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 16:59:03 devstack sudo[84089]: pam_unix(sudo:session): session closed for user root
Aug 26 16:59:03 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.236s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 16:59:03 devstack cinder-volume[83199]: INFO cinder.volume.manager [None req-1713cc69-ace0-4c77-b09d-3d58c2f05825 None None] Driver post RPC initialization completed successfully.
Aug 26 16:59:05 devstack cinder-volume[83046]: DEBUG dbcounter [-] [83046] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 16:59:13 devstack cinder-volume[83199]: DEBUG dbcounter [-] [83199] Writing DB stats cinder:SELECT=3 {{(pid=83199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 16:59:13 devstack cinder-volume[83199]: DEBUG dbcounter [-] [83199] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 16:59:51 devstack cinder-volume[83199]: DEBUG oslo_service.periodic_task [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running periodic task VolumeManager._thread_info {{(pid=83199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 16:59:51 devstack cinder-volume[83199]: DEBUG cinder.volume.manager [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] thread count: 6 {{(pid=83199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 16:59:51 devstack cinder-volume[83199]: DEBUG cinder.volume.manager [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] thread info: [<_MainThread(MainThread, started 124942605553792)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124942504133696)>, <Thread(Thread-3 (stat_writer), started daemon 124942491616192)>, <Thread(Rabbit-heartbeat, started daemon 124942490375168)>, <Thread(Thread-5 (_runner), started daemon 124942490509312)>, <Thread(Thread-7 (_runner), started daemon 124942490539840)>] {{(pid=83199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:00:51 devstack cinder-volume[83199]: DEBUG oslo_service.periodic_task [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:00:51 devstack cinder-volume[83199]: DEBUG cinder.volume.drivers.lvm [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Updating volume stats {{(pid=83199) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 17:00:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:00:51 devstack sudo[89280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 17:00:51 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:00:51 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root
Aug 26 17:00:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:00:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:00:51 devstack sudo[89283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 17:00:51 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:00:51 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root
Aug 26 17:00:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:00:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:00:51 devstack sudo[89286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 17:00:51 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:00:52 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root
Aug 26 17:00:52 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:00:52 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:00:52 devstack sudo[89289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 17:00:52 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:00:52 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root
Aug 26 17:00:52 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:00:52 devstack cinder-volume[83199]: DEBUG cinder.manager [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Notifying Schedulers of capabilities ... {{(pid=83199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:00:52 devstack cinder-volume[83199]: DEBUG oslo_service.periodic_task [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running periodic task VolumeManager._thread_info {{(pid=83199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:00:52 devstack cinder-volume[83199]: DEBUG cinder.volume.manager [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] thread count: 6 {{(pid=83199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:00:52 devstack cinder-volume[83199]: DEBUG cinder.volume.manager [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] thread info: [<_MainThread(MainThread, started 124942605553792)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124942504133696)>, <Thread(Thread-3 (stat_writer), started daemon 124942491616192)>, <Thread(Rabbit-heartbeat, started daemon 124942490375168)>, <Thread(Thread-5 (_runner), started daemon 124942490509312)>, <Thread(Thread-7 (_runner), started daemon 124942490539840)>] {{(pid=83199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:01:13 devstack cinder-volume[83199]: DEBUG dbcounter [-] [83199] Writing DB stats cinder:SELECT=1 {{(pid=83199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:01:13 devstack cinder-volume[83199]: DEBUG dbcounter [-] [83199] Writing DB stats cinder:UPDATE=1 {{(pid=83199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:01:51 devstack cinder-volume[83199]: DEBUG oslo_service.periodic_task [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:01:51 devstack cinder-volume[83199]: DEBUG cinder.volume.drivers.lvm [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Updating volume stats {{(pid=83199) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 17:01:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:01:51 devstack sudo[91146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 17:01:51 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:01:51 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root
Aug 26 17:01:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:01:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:01:51 devstack sudo[91163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 17:01:51 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:01:51 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root
Aug 26 17:01:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:01:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:01:51 devstack sudo[91172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 17:01:51 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:01:52 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root
Aug 26 17:01:52 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:01:52 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:01:52 devstack sudo[91180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 17:01:52 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:01:52 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root
Aug 26 17:01:52 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:01:52 devstack cinder-volume[83199]: DEBUG cinder.manager [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Notifying Schedulers of capabilities ... {{(pid=83199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:01:52 devstack cinder-volume[83199]: DEBUG oslo_service.periodic_task [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running periodic task VolumeManager._thread_info {{(pid=83199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:01:52 devstack cinder-volume[83199]: DEBUG cinder.volume.manager [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] thread count: 6 {{(pid=83199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:01:52 devstack cinder-volume[83199]: DEBUG cinder.volume.manager [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] thread info: [<_MainThread(MainThread, started 124942605553792)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124942504133696)>, <Thread(Thread-3 (stat_writer), started daemon 124942491616192)>, <Thread(Rabbit-heartbeat, started daemon 124942490375168)>, <Thread(Thread-5 (_runner), started daemon 124942490509312)>, <Thread(Thread-7 (_runner), started daemon 124942490539840)>] {{(pid=83199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:02:51 devstack cinder-volume[83199]: DEBUG oslo_service.periodic_task [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:02:51 devstack cinder-volume[83199]: DEBUG cinder.volume.drivers.lvm [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Updating volume stats {{(pid=83199) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 17:02:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:02:51 devstack sudo[92570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 17:02:51 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:02:51 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root
Aug 26 17:02:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:02:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:02:51 devstack sudo[92584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 17:02:51 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:02:51 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root
Aug 26 17:02:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:02:51 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:02:51 devstack sudo[92587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 17:02:51 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:02:52 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root
Aug 26 17:02:52 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.234s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:02:52 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:02:52 devstack sudo[92590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 17:02:52 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:02:52 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root
Aug 26 17:02:52 devstack cinder-volume[83199]: DEBUG oslo_concurrency.processutils [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=83199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:02:52 devstack cinder-volume[83199]: DEBUG cinder.manager [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Notifying Schedulers of capabilities ... {{(pid=83199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:02:52 devstack cinder-volume[83199]: DEBUG oslo_service.periodic_task [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] Running periodic task VolumeManager._thread_info {{(pid=83199) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:02:52 devstack cinder-volume[83199]: DEBUG cinder.volume.manager [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] thread count: 6 {{(pid=83199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:02:52 devstack cinder-volume[83199]: DEBUG cinder.volume.manager [None req-8f155b62-3529-40f5-811a-f516a6ab0ab4 None None] thread info: [<_MainThread(MainThread, started 124942605553792)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124942504133696)>, <Thread(Thread-3 (stat_writer), started daemon 124942491616192)>, <Thread(Rabbit-heartbeat, started daemon 124942490375168)>, <Thread(Thread-5 (_runner), started daemon 124942490509312)>, <Thread(Thread-7 (_runner), started daemon 124942490539840)>] {{(pid=83199) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:03:13 devstack cinder-volume[83199]: DEBUG dbcounter [-] [83199] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:03:20 devstack cinder-volume[83046]: INFO oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Caught SIGTERM, stopping children
Aug 26 17:03:20 devstack cinder-volume[83046]: DEBUG oslo_concurrency.lockutils [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Acquiring lock "singleton_lock" {{(pid=83046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 17:03:20 devstack cinder-volume[83046]: DEBUG oslo_concurrency.lockutils [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Acquired lock "singleton_lock" {{(pid=83046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 17:03:20 devstack cinder-volume[83046]: DEBUG oslo_concurrency.lockutils [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Releasing lock "singleton_lock" {{(pid=83046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 17:03:20 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Stop services. {{(pid=83046) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Aug 26 17:03:20 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Killing children. {{(pid=83046) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Aug 26 17:03:20 devstack cinder-volume[83046]: INFO oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Waiting on 1 children to exit
Aug 26 17:03:22 devstack cinder-volume[83199]: DEBUG oslo_concurrency.lockutils [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Acquiring lock "singleton_lock" {{(pid=83199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 17:03:22 devstack cinder-volume[83199]: DEBUG oslo_concurrency.lockutils [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Acquired lock "singleton_lock" {{(pid=83199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 17:03:22 devstack cinder-volume[83199]: DEBUG oslo_concurrency.lockutils [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Releasing lock "singleton_lock" {{(pid=83199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 17:03:22 devstack cinder-volume[83199]: WARNING amqp [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 26 17:03:22 devstack cinder-volume[83199]: WARNING amqp [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 26 17:03:22 devstack cinder-volume[83046]: INFO oslo_service.backend._eventlet.service [None req-5f3322cc-80fc-4a69-b162-ad9f3bc7ac82 None None] Child 83199 exited with status 0
Aug 26 17:03:22 devstack cinder-volume[93311]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 26 17:03:22 devstack cinder-volume[93311]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 26 17:03:22 devstack cinder-volume[93311]: we strongly recommend against using it for new projects.
Aug 26 17:03:22 devstack cinder-volume[93311]: If you are already using Eventlet, we recommend migrating to a different
Aug 26 17:03:22 devstack cinder-volume[93311]: framework.  For more detail see
Aug 26 17:03:22 devstack cinder-volume[93311]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 26 17:03:22 devstack cinder-volume[93311]:   import eventlet  # noqa
Aug 26 17:03:24 devstack cinder-volume[93311]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93311) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 17:03:24 devstack cinder-volume[93311]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93311) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 17:03:24 devstack cinder-volume[93311]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93311) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 17:03:25 devstack cinder-volume[93311]: INFO dbcounter [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Registered counter for database cinder
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_db.sqlalchemy.engines [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93311) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG dbcounter [-] [93311] Writer thread running {{(pid=93311) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 26 17:03:25 devstack cinder-volume[93311]: INFO cinder.rpc [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 26 17:03:25 devstack cinder-volume[93311]: INFO cinder.rpc [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_db.sqlalchemy.engines [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93311) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 17:03:25 devstack cinder-volume[93311]: INFO cinder.volume.manager [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Determined volume DB was empty at startup.
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG cinder.volume.manager [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93311) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 26 17:03:25 devstack cinder-volume[93311]: INFO cinder.volume.manager [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Service not found for updating active_backend_id, assuming default for driver init.
Aug 26 17:03:25 devstack cinder-volume[93311]: WARNING stevedore.named [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 26 17:03:25 devstack cinder-volume[93311]: WARNING castellan.key_manager [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 17:03:25 devstack cinder-volume[93311]: WARNING cinder.keymgr.conf_key_mgr [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 17:03:25 devstack cinder-volume[93311]: INFO cinder.volume.manager [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_db.sqlalchemy.engines [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93311) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 17:03:25 devstack cinder-volume[93311]: INFO oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Starting 1 workers
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Started child 93527 {{(pid=93311) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Full set of CONF: {{(pid=93311) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] ******************************************************************************** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Configuration options gathered from: {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] ================================================================================ {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] allow_availability_zone_fallback = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] allow_compression_on_image_upload = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] allowed_direct_url_schemes     = [] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93527]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] api_rate_limit                 = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] auth_strategy                  = keystone {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_availability_zone      = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_host                   = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_name                   = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_stats_polling_interval = 60 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backup_api_class               = cinder.backup.api.API {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backup_name_template           = backup-%s {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backup_use_same_host           = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backup_use_temp_snapshot       = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] chap_password                  = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] chap_username                  =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cinder_internal_tenant_project_id = b09f32110b2a4e818bbb23daa8dd5628 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cinder_internal_tenant_user_id = cb97d0463cb7406595aeafb3658b9de4 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cluster                        = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] compression_format             = gzip {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] compute_api_class              = cinder.compute.nova.API {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] config_dir                     = [] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] config_source                  = [] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] control_exchange               = openstack {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] debug                          = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] default_availability_zone      = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] default_group_type             = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] default_volume_type            = QuobyteHD {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] disk_geometry                  = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] driver_client_cert             = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] driver_client_cert_key         = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] driver_data_namespace          = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] driver_ssl_cert_path           = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] driver_ssl_cert_verify         = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] driver_use_ssl                 = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] enable_new_services            = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] enable_unsupported_driver      = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] enabled_backends               = ['QuobyteHD'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] enforce_multipath_for_image_xfer = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] filter_function                = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance_api_insecure            = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance_api_servers             = ['http://192.168.122.93/image'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance_api_ssl_compression     = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance_ca_certificates_file    = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance_catalog_info            = image:glance:publicURL {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance_certfile                = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance_keyfile                 = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance_num_retries             = 3 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance_request_timeout         = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] goodness_function              = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] graceful_shutdown_timeout      = 5 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] group_api_class                = cinder.group.api.API {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] host                           = devstack {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] image_compress_on_upload       = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] image_conversion_address_space_limit = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] image_conversion_cpu_limit     = 60 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] image_conversion_disable       = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] image_upload_use_cinder_backend = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] image_upload_use_internal_tenant = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] image_volume_cache_enabled     = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] image_volume_cache_max_count   = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] image_volume_cache_max_size_gb = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] init_host_max_objects_retrieval = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] instance_format                = [instance: %(uuid)s]  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] iscsi_target_flags             =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] iscsi_write_cache              = on {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] iser_helper                    = tgtadm {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] iser_ip_address                = 192.168.122.93 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] iser_port                      = 3260 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:25 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] log_color                      = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93527]: INFO cinder.volume.manager [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Starting volume driver QuobyteDriver (1.2)
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG cinder.volume.drivers.remotefs [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93527) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] log_config_append              = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] log_dir                        = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] log_file                       = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] log_options                    = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] log_rotate_interval            = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] log_rotate_interval_type       = days {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] log_rotation_type              = none {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] max_age                        = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] max_logfile_count              = 30 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] max_logfile_size_mb            = 200 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] max_over_subscription_ratio    = 20.0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] message_reap_interval          = 86400 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] message_ttl                    = 2592000 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] migration_create_volume_timeout_secs = 300 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] monkey_patch                   = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] monkey_patch_modules           = [] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] my_ip                          = 192.168.122.93 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] no_snapshot_gb_quota           = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] num_iser_scan_tries            = 3 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] num_shell_tries                = 3 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] num_volume_device_scan_tries   = 3 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] nvmeof_conn_info_version       = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] nvmet_ns_id                    = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] nvmet_port_id                  = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] osapi_max_limit                = 1000 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] osapi_volume_ext_list          = [] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] osapi_volume_listen_port       = 8776 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] osapi_volume_use_ssl           = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] osapi_volume_workers           = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] per_volume_size_limit          = -1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] periodic_fuzzy_delay           = 60 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] periodic_interval              = 60 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] public_endpoint                = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] publish_errors                 = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] quota_backup_gigabytes         = 1000 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] quota_backups                  = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] quota_gigabytes                = 1000 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] quota_groups                   = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] quota_snapshots                = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] quota_volumes                  = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] rate_limit_burst               = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] rate_limit_except_level        = CRITICAL {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] rate_limit_interval            = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] reinit_driver_count            = 3 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] replication_device             = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] report_discard_supported       = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] report_interval                = 120 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] reservation_clean_interval     = 86400 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] reservation_expire             = 86400 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] reserved_image_namespaces      = [] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] reserved_percentage            = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] rpc_response_timeout           = 120 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] run_external_periodic_tasks    = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] scst_target_driver             = iscsi {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] scst_target_iqn_name           = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] service_down_time              = 720 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] shell_completion               = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] snapshot_name_template         = snapshot-%s {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] split_loggers                  = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] state_path                     = /opt/stack/data/cinder {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] storage_availability_zone      = nova {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] storage_protocol               = iSCSI {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] syslog_log_facility            = LOG_USER {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] target_helper                  = lioadm {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] target_ip_address              = 192.168.122.93 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] target_port                    = 3260 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] target_protocol                = iscsi {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] target_secondary_ip_addresses  = [] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] trace_flags                    = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] transport_url                  = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] until_refresh                  = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] use_chap_auth                  = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] use_default_quota_class        = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] use_journal                    = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] use_json                       = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] use_multipath_for_image_xfer   = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] use_stderr                     = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] use_syslog                     = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] verify_glance_signatures       = enabled {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volume_api_class               = cinder.volume.api.API {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volume_backend_name            = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volume_clear                   = zero {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volume_clear_ionice            = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volume_clear_size              = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volume_copy_bps_limit          = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volume_dd_blocksize            = 1M {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volume_name_template           = volume-%s {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volume_service_inithost_offload = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volume_usage_audit_period      = month {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] zoning_mode                    = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_concurrency.disable_process_locking = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.auth_section = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.auth_type   = password {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.auth_version = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.cache       = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.certfile    = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.include_service_catalog = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.insecure    = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.interface   = public {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.keyfile     = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_password = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcache_username = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.region_name = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.service_type = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.93/identity {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.backend                  = dogpile.cache.null {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.backend_argument         = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.backend_expiration_time  = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.config_prefix            = cache.oslo {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.debug_cache_backend      = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.enable_retry_client      = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.enable_socket_keepalive  = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.enabled                  = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.expiration_time          = 600 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.hashclient_retry_attempts = 2 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.memcache_dead_retry      = 300 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.memcache_pool_maxsize    = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.memcache_sasl_enabled    = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.password                 = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG cinder.volume.drivers.quobyte [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93527) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Aug 26 17:03:26 devstack cinder-volume[93527]: WARNING cinder.volume.drivers.quobyte [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Aug 26 17:03:26 devstack cinder-volume[93527]: WARNING cinder.volume.drivers.quobyte [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG oslo_concurrency.processutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Running cmd (subprocess): mount.quobyte {{(pid=93527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.proxies                  = [] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.redis_db                 = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.redis_server             = localhost:6379 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.retry_attempts           = 2 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.retry_delay              = 0.0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.socket_keepalive_count   = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.socket_keepalive_idle    = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.socket_keepalive_interval = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.socket_timeout           = 1.0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.tls_allowed_ciphers      = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.tls_cafile               = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.tls_certfile             = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.tls_enabled              = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.tls_keyfile              = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cache.username                 = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] coordination.backend_url       = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.asyncio_connection    = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.asyncio_slave_connection = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.backend               = sqlalchemy {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.connection            = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.connection_debug      = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.connection_parameters =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.connection_recycle_time = 3600 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.connection_trace      = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.db_inc_retry_interval = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.db_max_retries        = 20 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.db_max_retry_interval = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.db_retry_interval     = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.max_overflow          = 50 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.max_pool_size         = 5 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.max_retries           = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.mysql_wsrep_sync_wait = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.pool_timeout          = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.retry_interval        = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.slave_connection      = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.sqlite_synchronous    = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.synchronous_reader    = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] database.use_db_reconnect      = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler.connection_string     = messaging:// {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler.enabled               = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler.es_doc_type           = notification {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler.es_scroll_size        = 10000 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler.es_scroll_time        = 2m {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler.filter_error_trace    = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler.hmac_keys             = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler.sentinel_service_name = mymaster {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler.socket_timeout        = 0.1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler.trace_requests        = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler.trace_sqlalchemy      = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler_jaeger.process_tags   = {} {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler_jaeger.service_name_prefix = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] profiler_otlp.service_name_prefix = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_policy.enforce_new_defaults = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_policy.policy_default_rule = default {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_policy.policy_file        = policy.yaml {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] privsep_osbrick.group          = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] privsep_osbrick.helper_command = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] privsep_osbrick.user           = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cinder_sys_admin.group         = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cinder_sys_admin.helper_command = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] cinder_sys_admin.user          = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] service_user.auth_section      = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] service_user.auth_type         = password {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] service_user.cafile            = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] service_user.certfile          = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] service_user.collect_timing    = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] service_user.insecure          = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] service_user.keyfile           = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] service_user.send_service_user_token = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] service_user.split_loggers     = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] service_user.timeout           = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance.auth_section            = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance.auth_type               = password {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance.certfile                = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance.collect_timing          = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance.insecure                = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance.keyfile                 = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance.region_name             = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance.split_loggers           = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] glance.timeout                 = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.backend_availability_zone = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.chap_password = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.chap_username =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.disk_geometry = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.driver_client_cert = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.driver_client_cert_key = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.driver_data_namespace = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.driver_use_ssl = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.extra_capabilities = {} {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.filter_function = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.goodness_function = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.iscsi_target_flags =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.iscsi_write_cache = on {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.iser_helper   = tgtadm {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.iser_ip_address = 192.168.122.93 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.iser_port     = 3260 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nas_host      =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nas_login     = admin {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nas_mount_options = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nas_password  = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nas_private_key =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nas_share_path =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.num_shell_tries = 3 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.quobyte_volume_url = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.replication_device = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.report_discard_supported = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.reserved_percentage = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.target_helper = tgtadm {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.target_ip_address = 192.168.122.93 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.target_port   = 3260 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.target_protocol = iscsi {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.trace_flags   = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.unique_fqdn_network = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.use_chap_auth = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.volume_backend_name = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.volume_clear  = zero {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.volume_clear_ionice = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.volume_clear_size = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_reports.file_event_handler = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_reports.log_dir           = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.backend_availability_zone = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.backend_host         = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.chap_password        = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.chap_username        = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.chiscsi_conf         = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.disk_geometry        = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.driver_client_cert   = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.driver_data_namespace = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.driver_use_ssl       = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.extra_capabilities   = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.filter_function      = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.goodness_function    = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.iser_helper          = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.iser_ip_address      = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.iser_port            = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.iser_target_prefix   = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nas_host             = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nas_login            = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nas_mount_options    = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nas_password         = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nas_private_key      = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nas_share_path       = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nas_ssh_port         = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.num_shell_tries      = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.nvmet_port_id        = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.replication_device   = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.report_discard_supported = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.reserved_percentage  = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.scst_target_driver   = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.storage_protocol     = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.target_helper        = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.target_ip_address    = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.target_port          = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.target_prefix        = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.target_protocol      = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.trace_flags          = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.use_chap_auth        = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.volume_clear         = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.volume_clear_size    = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] QuobyteHD.volumes_dir          = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.ssl      = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_notifications.driver = [] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_notifications.retry = -1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] key_manager.fixed_key          = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.barbican_api_version  = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.barbican_endpoint     = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.barbican_endpoint_type = public {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.barbican_region_name  = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.cafile                = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.certfile              = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.collect_timing        = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.insecure              = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.keyfile               = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.number_of_retries     = 60 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.retry_delay           = 1 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.send_service_user_token = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.split_loggers         = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.timeout               = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.verify_ssl            = True {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican.verify_ssl_path       = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican_service_user.auth_section = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican_service_user.auth_type = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican_service_user.cafile   = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican_service_user.certfile = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican_service_user.collect_timing = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG oslo_concurrency.processutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] CMD "mount.quobyte" returned: 1 in 0.189s {{(pid=93527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican_service_user.insecure = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican_service_user.keyfile  = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican_service_user.split_loggers = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG cinder.volume.drivers.quobyte [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=93527) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] barbican_service_user.timeout  = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.approle_role_id          = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.approle_secret_id        = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93527]: INFO cinder.volume.drivers.quobyte [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 ...
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.auth_method              = approle {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.auth_path                = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG oslo_concurrency.processutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 -c /etc/quobyte/client-cinder.cfg {{(pid=93527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.kv_mountpoint            = secret {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.kv_path                  = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.kv_version               = 2 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.namespace                = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.root_token_id            = **** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.ssl_ca_crt_file          = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.timeout                  = 60.0 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.token_file               = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.token_role               = None {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.use_ssl                  = False {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:26 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] ******************************************************************************** {{(pid=93311) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Aug 26 17:03:26 devstack sudo[93539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 -c /etc/quobyte/client-cinder.cfg
Aug 26 17:03:26 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:03:26 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG oslo_concurrency.processutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.363s {{(pid=93527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:03:26 devstack cinder-volume[93527]: INFO cinder.volume.drivers.quobyte [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 succeeded
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG cinder.volume.drivers.quobyte [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=93527) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.376s {{(pid=93527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG oslo_concurrency.processutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=93527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:03:26 devstack sudo[93608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:03:26 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:03:26 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG oslo_concurrency.processutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.250s {{(pid=93527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:03:26 devstack cinder-volume[93527]: INFO cinder.volume.driver [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Driver hasn't implemented _init_vendor_properties()
Aug 26 17:03:26 devstack cinder-volume[93527]: DEBUG cinder.volume.driver [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.724536895752, 'free_capacity_gb': 1774.724536895752, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93527) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG oslo_db.sqlalchemy.engines [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG dbcounter [-] [93527] Writer thread running {{(pid=93527) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG cinder.db.api [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Building query based on filter {{(pid=93527) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG cinder.image.image_utils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93527) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 26 17:03:27 devstack cinder-volume[93527]: INFO cinder.keymgr.migration [None req-ab4548f9-03b3-4479-9ee5-865332fe70d3 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG cinder.volume.drivers.quobyte [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=93527) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG cinder.volume.drivers.quobyte [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=93527) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG oslo_concurrency.processutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=93527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:03:27 devstack sudo[93612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:03:27 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:03:27 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG oslo_concurrency.processutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.226s {{(pid=93527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG cinder.manager [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Notifying Schedulers of capabilities ... {{(pid=93527) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:03:27 devstack cinder-volume[93527]: INFO cinder.volume.manager [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Driver initialization completed successfully.
Aug 26 17:03:27 devstack cinder-volume[93527]: INFO cinder.manager [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Initiating service 3 cleanup
Aug 26 17:03:27 devstack cinder-volume[93527]: INFO cinder.manager [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Service 3 cleanup completed.
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG cinder.service [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Creating RPC server for service cinder-volume {{(pid=93527) start /opt/stack/cinder/cinder/service.py:231}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG cinder.service [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93527) start /opt/stack/cinder/cinder/service.py:237}}
Aug 26 17:03:27 devstack cinder-volume[93527]: INFO cinder.volume.manager [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG cinder.volume.drivers.quobyte [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=93527) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG cinder.volume.drivers.quobyte [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=93527) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG oslo_concurrency.processutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=93527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:03:27 devstack sudo[93615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:03:27 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:03:27 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root
Aug 26 17:03:27 devstack cinder-volume[93527]: DEBUG oslo_concurrency.processutils [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.267s {{(pid=93527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:03:27 devstack cinder-volume[93527]: INFO cinder.volume.manager [None req-32b60283-2814-4493-adbe-95c8a96e9d49 None None] Driver post RPC initialization completed successfully.
Aug 26 17:03:32 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-2e3f787a-99bb-45c9-a028-6c011b879af4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:03:32 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-2e3f787a-99bb-45c9-a028-6c011b879af4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:03:32 devstack cinder-volume[93527]: DEBUG cinder.volume.drivers.quobyte [None req-2e3f787a-99bb-45c9-a028-6c011b879af4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=93527) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:03:32 devstack cinder-volume[93527]: DEBUG cinder.volume.drivers.quobyte [None req-2e3f787a-99bb-45c9-a028-6c011b879af4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=93527) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:03:32 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-2e3f787a-99bb-45c9-a028-6c011b879af4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93527) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:03:32 devstack cinder-volume[93527]: DEBUG oslo_concurrency.processutils [None req-2e3f787a-99bb-45c9-a028-6c011b879af4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=93527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:03:32 devstack sudo[93764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:03:32 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:03:32 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root
Aug 26 17:03:32 devstack cinder-volume[93527]: DEBUG oslo_concurrency.processutils [None req-2e3f787a-99bb-45c9-a028-6c011b879af4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.257s {{(pid=93527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:03:32 devstack cinder-volume[93527]: DEBUG cinder.manager [None req-2e3f787a-99bb-45c9-a028-6c011b879af4 None None] Notifying Schedulers of capabilities ... {{(pid=93527) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:03:32 devstack cinder-volume[93311]: INFO oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Caught SIGTERM, stopping children
Aug 26 17:03:32 devstack cinder-volume[93311]: DEBUG oslo_concurrency.lockutils [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Acquiring lock "singleton_lock" {{(pid=93311) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 17:03:32 devstack cinder-volume[93311]: DEBUG oslo_concurrency.lockutils [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Acquired lock "singleton_lock" {{(pid=93311) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 17:03:32 devstack cinder-volume[93311]: DEBUG oslo_concurrency.lockutils [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Releasing lock "singleton_lock" {{(pid=93311) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 17:03:32 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Stop services. {{(pid=93311) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Aug 26 17:03:32 devstack cinder-volume[93311]: DEBUG oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Killing children. {{(pid=93311) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Aug 26 17:03:32 devstack cinder-volume[93311]: INFO oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Waiting on 1 children to exit
Aug 26 17:03:34 devstack cinder-volume[93527]: DEBUG oslo_service.periodic_task [None req-bcdb88e4-d983-4a5b-a9b5-b9937585e881 None None] Running periodic task VolumeManager._thread_info {{(pid=93527) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:03:34 devstack cinder-volume[93527]: DEBUG cinder.volume.manager [None req-bcdb88e4-d983-4a5b-a9b5-b9937585e881 None None] thread count: 6 {{(pid=93527) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:03:34 devstack cinder-volume[93527]: DEBUG cinder.volume.manager [None req-bcdb88e4-d983-4a5b-a9b5-b9937585e881 None None] thread info: [<_MainThread(MainThread, started 131689239703680)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131689127067264)>, <Thread(Thread-3 (stat_writer), started daemon 131689125532928)>, <Thread(Rabbit-heartbeat, started daemon 131689124736000)>, <Thread(Thread-7 (_runner), started daemon 131689123044864)>, <Thread(Thread-4 (_process_in_background), started daemon 131689128873920)>] {{(pid=93527) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:03:35 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Acquiring lock "singleton_lock" {{(pid=93527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 17:03:35 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Acquired lock "singleton_lock" {{(pid=93527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 17:03:35 devstack cinder-volume[93527]: DEBUG oslo_concurrency.lockutils [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Releasing lock "singleton_lock" {{(pid=93527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 17:03:35 devstack cinder-volume[93527]: WARNING amqp [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 26 17:03:35 devstack cinder-volume[93527]: WARNING amqp [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 26 17:03:35 devstack cinder-volume[93311]: INFO oslo_service.backend._eventlet.service [None req-8b8c657b-1a6d-40ba-9e3f-707616a07d81 None None] Child 93527 exited with status 0
Aug 26 17:03:36 devstack cinder-volume[93819]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 26 17:03:36 devstack cinder-volume[93819]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 26 17:03:36 devstack cinder-volume[93819]: we strongly recommend against using it for new projects.
Aug 26 17:03:36 devstack cinder-volume[93819]: If you are already using Eventlet, we recommend migrating to a different
Aug 26 17:03:36 devstack cinder-volume[93819]: framework.  For more detail see
Aug 26 17:03:36 devstack cinder-volume[93819]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 26 17:03:36 devstack cinder-volume[93819]:   import eventlet  # noqa
Aug 26 17:03:39 devstack cinder-volume[93819]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93819) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 17:03:39 devstack cinder-volume[93819]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93819) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 17:03:39 devstack cinder-volume[93819]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93819) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 17:03:40 devstack cinder-volume[93819]: INFO dbcounter [None req-2917e593-1247-481e-9d86-115878dd9776 None None] Registered counter for database cinder
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_db.sqlalchemy.engines [None req-2917e593-1247-481e-9d86-115878dd9776 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG dbcounter [-] [93819] Writer thread running {{(pid=93819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 26 17:03:40 devstack cinder-volume[93819]: INFO cinder.rpc [None req-2917e593-1247-481e-9d86-115878dd9776 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 26 17:03:40 devstack cinder-volume[93819]: INFO cinder.rpc [None req-2917e593-1247-481e-9d86-115878dd9776 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_db.sqlalchemy.engines [None req-2917e593-1247-481e-9d86-115878dd9776 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 17:03:40 devstack cinder-volume[93819]: INFO cinder.volume.manager [None req-2917e593-1247-481e-9d86-115878dd9776 None None] Determined volume DB was empty at startup.
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG cinder.volume.manager [None req-2917e593-1247-481e-9d86-115878dd9776 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93819) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 26 17:03:40 devstack cinder-volume[93819]: WARNING stevedore.named [None req-2917e593-1247-481e-9d86-115878dd9776 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 26 17:03:40 devstack cinder-volume[93819]: WARNING castellan.key_manager [None req-2917e593-1247-481e-9d86-115878dd9776 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 17:03:40 devstack cinder-volume[93819]: WARNING cinder.keymgr.conf_key_mgr [None req-2917e593-1247-481e-9d86-115878dd9776 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 17:03:40 devstack cinder-volume[93819]: INFO cinder.volume.manager [None req-2917e593-1247-481e-9d86-115878dd9776 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_db.sqlalchemy.engines [None req-2917e593-1247-481e-9d86-115878dd9776 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 17:03:40 devstack cinder-volume[93819]: INFO oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] Starting 1 workers
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] Started child 94125 {{(pid=93819) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] Full set of CONF: {{(pid=93819) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] ******************************************************************************** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] Configuration options gathered from: {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Aug 26 17:03:40 devstack cinder-volume[94125]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] ================================================================================ {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] allow_availability_zone_fallback = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] allow_compression_on_image_upload = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] allowed_direct_url_schemes     = [] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] api_rate_limit                 = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] auth_strategy                  = keystone {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_availability_zone      = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_host                   = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_name                   = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_stats_polling_interval = 60 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backup_api_class               = cinder.backup.api.API {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backup_name_template           = backup-%s {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backup_use_same_host           = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backup_use_temp_snapshot       = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] chap_password                  = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] chap_username                  =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cinder_internal_tenant_project_id = b09f32110b2a4e818bbb23daa8dd5628 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cinder_internal_tenant_user_id = cb97d0463cb7406595aeafb3658b9de4 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cluster                        = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] compression_format             = gzip {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] compute_api_class              = cinder.compute.nova.API {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] config_dir                     = [] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] config_source                  = [] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] control_exchange               = openstack {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] debug                          = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] default_availability_zone      = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] default_group_type             = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] default_volume_type            = QuobyteHD {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] disk_geometry                  = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] driver_client_cert             = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] driver_client_cert_key         = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] driver_data_namespace          = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] driver_ssl_cert_path           = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] driver_ssl_cert_verify         = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] driver_use_ssl                 = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] enable_new_services            = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] enable_unsupported_driver      = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] enabled_backends               = ['QuobyteHD'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] enforce_multipath_for_image_xfer = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] filter_function                = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance_api_insecure            = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance_api_servers             = ['http://192.168.122.93/image'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance_api_ssl_compression     = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance_ca_certificates_file    = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance_catalog_info            = image:glance:publicURL {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance_certfile                = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance_keyfile                 = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance_num_retries             = 3 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance_request_timeout         = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] goodness_function              = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] graceful_shutdown_timeout      = 5 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] group_api_class                = cinder.group.api.API {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] host                           = devstack {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] image_compress_on_upload       = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] image_conversion_address_space_limit = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] image_conversion_cpu_limit     = 60 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] image_conversion_disable       = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] image_upload_use_cinder_backend = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] image_upload_use_internal_tenant = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] image_volume_cache_enabled     = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] image_volume_cache_max_count   = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] image_volume_cache_max_size_gb = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] init_host_max_objects_retrieval = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] instance_format                = [instance: %(uuid)s]  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] iscsi_target_flags             =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] iscsi_write_cache              = on {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] iser_helper                    = tgtadm {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] iser_ip_address                = 192.168.122.93 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] iser_port                      = 3260 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] log_color                      = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] log_config_append              = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] log_dir                        = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Starting volume driver QuobyteDriver (1.2)
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] log_file                       = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94125) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] log_options                    = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] log_rotate_interval            = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] log_rotate_interval_type       = days {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] log_rotation_type              = none {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] max_age                        = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] max_logfile_count              = 30 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] max_logfile_size_mb            = 200 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] max_over_subscription_ratio    = 20.0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] message_reap_interval          = 86400 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] message_ttl                    = 2592000 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] migration_create_volume_timeout_secs = 300 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] monkey_patch                   = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] monkey_patch_modules           = [] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] my_ip                          = 192.168.122.93 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] no_snapshot_gb_quota           = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] num_iser_scan_tries            = 3 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] num_shell_tries                = 3 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] num_volume_device_scan_tries   = 3 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] nvmeof_conn_info_version       = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] nvmet_ns_id                    = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] nvmet_port_id                  = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] osapi_max_limit                = 1000 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] osapi_volume_ext_list          = [] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] osapi_volume_listen_port       = 8776 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] osapi_volume_use_ssl           = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] osapi_volume_workers           = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] per_volume_size_limit          = -1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] periodic_fuzzy_delay           = 60 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] periodic_interval              = 60 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] public_endpoint                = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] publish_errors                 = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] quota_backup_gigabytes         = 1000 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] quota_backups                  = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] quota_gigabytes                = 1000 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] quota_groups                   = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] quota_snapshots                = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] quota_volumes                  = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] rate_limit_burst               = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] rate_limit_except_level        = CRITICAL {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] rate_limit_interval            = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] reinit_driver_count            = 3 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] replication_device             = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] report_discard_supported       = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] report_interval                = 120 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] reservation_clean_interval     = 86400 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] reservation_expire             = 86400 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] reserved_image_namespaces      = [] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] reserved_percentage            = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] rpc_response_timeout           = 120 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] run_external_periodic_tasks    = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] scst_target_driver             = iscsi {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] scst_target_iqn_name           = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] service_down_time              = 720 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] shell_completion               = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] snapshot_name_template         = snapshot-%s {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] split_loggers                  = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] state_path                     = /opt/stack/data/cinder {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] storage_availability_zone      = nova {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] storage_protocol               = iSCSI {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] syslog_log_facility            = LOG_USER {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] target_helper                  = lioadm {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] target_ip_address              = 192.168.122.93 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] target_port                    = 3260 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] target_protocol                = iscsi {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] target_secondary_ip_addresses  = [] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] trace_flags                    = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] transport_url                  = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] until_refresh                  = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] use_chap_auth                  = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] use_default_quota_class        = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] use_journal                    = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] use_json                       = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] use_multipath_for_image_xfer   = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] use_stderr                     = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] use_syslog                     = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] verify_glance_signatures       = enabled {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volume_api_class               = cinder.volume.api.API {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volume_backend_name            = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volume_clear                   = zero {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volume_clear_ionice            = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volume_clear_size              = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volume_copy_bps_limit          = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volume_dd_blocksize            = 1M {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volume_name_template           = volume-%s {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volume_service_inithost_offload = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volume_usage_audit_period      = month {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] zoning_mode                    = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_concurrency.disable_process_locking = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.auth_section = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.auth_type   = password {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.auth_version = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.cache       = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.certfile    = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.include_service_catalog = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.insecure    = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.interface   = public {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.keyfile     = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_password = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcache_username = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.region_name = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.service_type = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.93/identity {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.backend                  = dogpile.cache.null {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.backend_argument         = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.backend_expiration_time  = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.config_prefix            = cache.oslo {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.debug_cache_backend      = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.enable_retry_client      = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.enable_socket_keepalive  = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.enabled                  = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.expiration_time          = 600 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.hashclient_retry_attempts = 2 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94125) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.memcache_dead_retry      = 300 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.quobyte [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.memcache_pool_maxsize    = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.memcache_sasl_enabled    = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.password                 = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.proxies                  = [] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.redis_db                 = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.quobyte [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.redis_server             = localhost:6379 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.retry_attempts           = 2 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.retry_delay              = 0.0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.socket_keepalive_count   = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.socket_keepalive_idle    = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.socket_keepalive_interval = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.socket_timeout           = 1.0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.tls_allowed_ciphers      = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.tls_cafile               = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.tls_certfile             = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.tls_enabled              = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.tls_keyfile              = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cache.username                 = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Running cmd (subprocess): mount.quobyte {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] coordination.backend_url       = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.asyncio_connection    = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.asyncio_slave_connection = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.backend               = sqlalchemy {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.connection            = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.connection_debug      = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.connection_parameters =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.connection_recycle_time = 3600 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.connection_trace      = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.db_inc_retry_interval = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.db_max_retries        = 20 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.db_max_retry_interval = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.db_retry_interval     = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.max_overflow          = 50 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.max_pool_size         = 5 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.max_retries           = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.mysql_wsrep_sync_wait = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.pool_timeout          = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.retry_interval        = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.slave_connection      = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.sqlite_synchronous    = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.synchronous_reader    = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] database.use_db_reconnect      = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler.connection_string     = messaging:// {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler.enabled               = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler.es_doc_type           = notification {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler.es_scroll_size        = 10000 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler.es_scroll_time        = 2m {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler.filter_error_trace    = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler.hmac_keys             = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler.sentinel_service_name = mymaster {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler.socket_timeout        = 0.1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler.trace_requests        = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler.trace_sqlalchemy      = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler_jaeger.process_tags   = {} {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler_jaeger.service_name_prefix = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] profiler_otlp.service_name_prefix = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_policy.enforce_new_defaults = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_policy.policy_default_rule = default {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_policy.policy_file        = policy.yaml {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] privsep_osbrick.group          = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] privsep_osbrick.helper_command = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] privsep_osbrick.user           = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cinder_sys_admin.group         = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cinder_sys_admin.helper_command = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] cinder_sys_admin.user          = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] service_user.auth_section      = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] service_user.auth_type         = password {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] service_user.cafile            = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] service_user.certfile          = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] service_user.collect_timing    = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:40 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] service_user.insecure          = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] service_user.keyfile           = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] service_user.send_service_user_token = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] service_user.split_loggers     = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] service_user.timeout           = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance.auth_section            = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance.auth_type               = password {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance.certfile                = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance.collect_timing          = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance.insecure                = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance.keyfile                 = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance.region_name             = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance.split_loggers           = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] glance.timeout                 = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.backend_availability_zone = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.chap_password = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.chap_username =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.disk_geometry = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.driver_client_cert = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.driver_client_cert_key = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.driver_data_namespace = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.driver_use_ssl = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.extra_capabilities = {} {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.filter_function = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.goodness_function = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.iscsi_target_flags =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.iscsi_write_cache = on {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.iser_helper   = tgtadm {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.iser_ip_address = 192.168.122.93 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.iser_port     = 3260 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nas_host      =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nas_login     = admin {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nas_mount_options = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nas_password  = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nas_private_key =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nas_share_path =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.num_shell_tries = 3 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.quobyte_volume_url = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.replication_device = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.report_discard_supported = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.reserved_percentage = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.target_helper = tgtadm {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.target_ip_address = 192.168.122.93 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.target_port   = 3260 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.target_protocol = iscsi {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.trace_flags   = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.unique_fqdn_network = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.use_chap_auth = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.volume_backend_name = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.volume_clear  = zero {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.volume_clear_ionice = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.volume_clear_size = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_reports.file_event_handler = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_reports.log_dir           = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.backend_availability_zone = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.backend_host         = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.chap_password        = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.chap_username        = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.chiscsi_conf         = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.disk_geometry        = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.driver_client_cert   = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.driver_data_namespace = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.driver_use_ssl       = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.extra_capabilities   = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.filter_function      = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.goodness_function    = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.iser_helper          = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.iser_ip_address      = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.iser_port            = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.iser_target_prefix   = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nas_host             = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nas_login            = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nas_mount_options    = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nas_password         = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nas_private_key      = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nas_share_path       = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nas_ssh_port         = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.num_shell_tries      = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.nvmet_port_id        = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.replication_device   = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.report_discard_supported = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.reserved_percentage  = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.scst_target_driver   = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.storage_protocol     = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.target_helper        = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.target_ip_address    = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.target_port          = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.target_prefix        = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.target_protocol      = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.trace_flags          = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.use_chap_auth        = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.volume_clear         = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.volume_clear_size    = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] QuobyteHD.volumes_dir          = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.ssl      = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack quobyte-client[94127]: Reading configuration file: /etc/quobyte/client.cfg
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack quobyte-client[94127]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_notifications.driver = [] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_notifications.retry = -1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] key_manager.fixed_key          = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.barbican_api_version  = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.barbican_endpoint     = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.barbican_endpoint_type = public {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.barbican_region_name  = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.cafile                = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.certfile              = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.collect_timing        = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.insecure              = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.keyfile               = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.number_of_retries     = 60 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.retry_delay           = 1 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.send_service_user_token = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.split_loggers         = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.timeout               = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.verify_ssl            = True {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican.verify_ssl_path       = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican_service_user.auth_section = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican_service_user.auth_type = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican_service_user.cafile   = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican_service_user.certfile = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican_service_user.collect_timing = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican_service_user.insecure = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican_service_user.keyfile  = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican_service_user.split_loggers = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] barbican_service_user.timeout  = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.approle_role_id          = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.approle_secret_id        = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.auth_method              = approle {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.auth_path                = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.kv_mountpoint            = secret {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.kv_path                  = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.kv_version               = 2 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.namespace                = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.root_token_id            = **** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.ssl_ca_crt_file          = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.timeout                  = 60.0 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.token_file               = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] CMD "mount.quobyte" returned: 1 in 0.118s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.token_role               = None {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.use_ssl                  = False {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 17:03:41 devstack cinder-volume[93819]: DEBUG oslo_service.backend._eventlet.service [None req-2917e593-1247-481e-9d86-115878dd9776 None None] ******************************************************************************** {{(pid=93819) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:03:41 devstack sudo[94135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:03:41 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:03:41 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.257s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:03:41 devstack cinder-volume[94125]: INFO cinder.volume.driver [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Driver hasn't implemented _init_vendor_properties()
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG cinder.volume.driver [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.723487854004, 'free_capacity_gb': 1774.723487854004, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94125) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_db.sqlalchemy.engines [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94125) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writer thread running {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG cinder.db.api [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Building query based on filter {{(pid=94125) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94125) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:03:41 devstack cinder-volume[94125]: INFO cinder.keymgr.migration [None req-5f666392-3ce7-426d-8f85-57c8dfcc302e None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 26 17:03:41 devstack sudo[94146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:03:41 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:03:41 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.242s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:03:41 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Driver initialization completed successfully.
Aug 26 17:03:41 devstack cinder-volume[94125]: INFO cinder.manager [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Initiating service 3 cleanup
Aug 26 17:03:41 devstack cinder-volume[94125]: INFO cinder.manager [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Service 3 cleanup completed.
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG cinder.service [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Creating RPC server for service cinder-volume {{(pid=94125) start /opt/stack/cinder/cinder/service.py:231}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG cinder.service [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94125) start /opt/stack/cinder/cinder/service.py:237}}
Aug 26 17:03:41 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:03:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:03:41 devstack sudo[94159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:03:41 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:03:42 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root
Aug 26 17:03:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.231s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:03:42 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-09b409f7-4852-4a10-9294-92837c5d66b1 None None] Driver post RPC initialization completed successfully.
Aug 26 17:03:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:03:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 6 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:03:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:03:50 devstack cinder-volume[93819]: DEBUG dbcounter [-] [93819] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93819) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:03:51 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:03:52 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:04:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:04:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:04:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:04:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:04:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:04:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:04:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:04:42 devstack sudo[94743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:04:42 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:04:43 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root
Aug 26 17:04:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.900s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:04:43 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:04:43 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:04:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 6 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:04:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:04:49 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:04:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Flow 'volume_create_manager' (0944fe6a-9f59-4656-948a-1be301a52fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:04:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76aedcb-fb6c-476b-9b3c-1339fd953c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:04:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76aedcb-fb6c-476b-9b3c-1339fd953c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1287145371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13959bb9-428c-423e-8b51-f58b1bd4f577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47fe9767d2cb46d2839842c780accc5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:04:50Z,use_quota=True,user_id='728271a9a9b94c918b9b8387ca5bda7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:04:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4169916-e5f3-4a76-90b9-e1bc75e0b652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4169916-e5f3-4a76-90b9-e1bc75e0b652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5e982b-33ec-459e-9e38-6f9dbfcff8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5e982b-33ec-459e-9e38-6f9dbfcff8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13959bb9-428c-423e-8b51-f58b1bd4f577', 'volume_name': 'volume-13959bb9-428c-423e-8b51-f58b1bd4f577', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ff01c8-aeb0-4e9f-9308-147bf400cc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ff01c8-aeb0-4e9f-9308-147bf400cc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbda4405-dcbe-4e09-90ab-09ed0885a5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:04:50 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Volume 13959bb9-428c-423e-8b51-f58b1bd4f577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13959bb9-428c-423e-8b51-f58b1bd4f577', 'volume_size': 1}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1287145371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13959bb9-428c-423e-8b51-f58b1bd4f577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47fe9767d2cb46d2839842c780accc5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:04:50Z,use_quota=True,user_id='728271a9a9b94c918b9b8387ca5bda7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Creating volume 13959bb9-428c-423e-8b51-f58b1bd4f577 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:04:50 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:04:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-13959bb9-428c-423e-8b51-f58b1bd4f577 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:04:50 devstack sudo[94921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-13959bb9-428c-423e-8b51-f58b1bd4f577 1073741824
Aug 26 17:04:50 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:04:51 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root
Aug 26 17:04:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-13959bb9-428c-423e-8b51-f58b1bd4f577 1073741824" returned: 0 in 1.208s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:04:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-13959bb9-428c-423e-8b51-f58b1bd4f577 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:04:51 devstack sudo[95260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-13959bb9-428c-423e-8b51-f58b1bd4f577
Aug 26 17:04:51 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:04:52 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root
Aug 26 17:04:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-13959bb9-428c-423e-8b51-f58b1bd4f577" returned: 0 in 0.866s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:04:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:04:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.345s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:04:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbda4405-dcbe-4e09-90ab-09ed0885a5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13959bb9-428c-423e-8b51-f58b1bd4f577', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:04:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece7db43-5870-4458-9402-6389b81c5aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:04:52 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Volume volume-13959bb9-428c-423e-8b51-f58b1bd4f577 (13959bb9-428c-423e-8b51-f58b1bd4f577): created successfully
Aug 26 17:04:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece7db43-5870-4458-9402-6389b81c5aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:04:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Flow 'volume_create_manager' (0944fe6a-9f59-4656-948a-1be301a52fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:04:52 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-35fe90b2-83df-413b-812a-248a85c98289 tempest-DeleteServersTestJSON-247740993 None] Created volume successfully.
Aug 26 17:05:00 devstack cinder-volume[94125]: WARNING py.warnings [req-808aa3d1-03f1-408f-9f58-3dba08849620 req-bda8c0c9-7198-46f3-8637-7c3e6372df80 tempest-DeleteServersTestJSON-247740993 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Aug 26 17:05:00 devstack cinder-volume[94125]:   .first()
Aug 26 17:05:00 devstack cinder-volume[94125]: 
Aug 26 17:05:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-808aa3d1-03f1-408f-9f58-3dba08849620 req-bda8c0c9-7198-46f3-8637-7c3e6372df80 tempest-DeleteServersTestJSON-247740993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:05:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-808aa3d1-03f1-408f-9f58-3dba08849620 req-bda8c0c9-7198-46f3-8637-7c3e6372df80 tempest-DeleteServersTestJSON-247740993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:05:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-808aa3d1-03f1-408f-9f58-3dba08849620 req-bda8c0c9-7198-46f3-8637-7c3e6372df80 tempest-DeleteServersTestJSON-247740993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:05:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-808aa3d1-03f1-408f-9f58-3dba08849620 req-bda8c0c9-7198-46f3-8637-7c3e6372df80 tempest-DeleteServersTestJSON-247740993 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-13959bb9-428c-423e-8b51-f58b1bd4f577', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46383ff8-3dd7-4a85-b8e8-6db580703e28', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:05:00 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-808aa3d1-03f1-408f-9f58-3dba08849620 req-bda8c0c9-7198-46f3-8637-7c3e6372df80 tempest-DeleteServersTestJSON-247740993 None] attachment_update completed successfully.
Aug 26 17:05:08 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-56ebdea9-f80c-4e13-a5be-f425f55dea05 req-ab3ae58c-bb95-4ac7-951b-7a3a8e159433 tempest-DeleteServersTestJSON-247740993 None] Terminate volume connection completed successfully.
Aug 26 17:05:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-56ebdea9-f80c-4e13-a5be-f425f55dea05 req-ab3ae58c-bb95-4ac7-951b-7a3a8e159433 tempest-DeleteServersTestJSON-247740993 None] Deleting attachment 46383ff8-3dd7-4a85-b8e8-6db580703e28. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:05:10 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:05:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Acquiring lock "cinder-13959bb9-428c-423e-8b51-f58b1bd4f577-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:05:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Lock "cinder-13959bb9-428c-423e-8b51-f58b1bd4f577-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:05:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Acquiring lock "cinder-quobyte-13959bb9-428c-423e-8b51-f58b1bd4f577" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:05:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Lock "cinder-quobyte-13959bb9-428c-423e-8b51-f58b1bd4f577" acquired by "delete_volume" :: waited 0.060s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:05:11 devstack cinder-volume[94125]: INFO oslo.privsep.daemon [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpywlhl98k/privsep.sock']
Aug 26 17:05:11 devstack sudo[96014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpywlhl98k/privsep.sock
Aug 26 17:05:11 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Flow 'volume_create_manager' (0375bb10-75fd-4d4e-9928-7540f139ab05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d20d97-9c18-49ae-a902-39c88c17f394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d20d97-9c18-49ae-a902-39c88c17f394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1294906568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b625e92-1942-4961-a343-d7798d32383f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eac7031fa2d4836b2cb5619ec524da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:05:12Z,use_quota=True,user_id='f53137abe24f40d29c00ae01427f285a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a1d148-153c-4b0a-a1fd-a23f5428128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a1d148-153c-4b0a-a1fd-a23f5428128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e9c5eb-9f2f-4373-bb27-e5448b7253cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e9c5eb-9f2f-4373-bb27-e5448b7253cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b625e92-1942-4961-a343-d7798d32383f', 'volume_name': 'volume-5b625e92-1942-4961-a343-d7798d32383f', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb75229d-7b1b-426b-b75d-b2c71280a3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb75229d-7b1b-426b-b75d-b2c71280a3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2318c3a8-d8e3-48db-99a3-c80d166d01f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:05:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Volume 5b625e92-1942-4961-a343-d7798d32383f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b625e92-1942-4961-a343-d7798d32383f', 'volume_size': 1}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1294906568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b625e92-1942-4961-a343-d7798d32383f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eac7031fa2d4836b2cb5619ec524da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:05:12Z,use_quota=True,user_id='f53137abe24f40d29c00ae01427f285a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Creating volume 5b625e92-1942-4961-a343-d7798d32383f {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:05:12 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:05:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5b625e92-1942-4961-a343-d7798d32383f 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:12 devstack sudo[96017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5b625e92-1942-4961-a343-d7798d32383f 1073741824
Aug 26 17:05:12 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:13 devstack cinder-volume[94125]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Aug 26 17:05:13 devstack cinder-volume[94125]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 26 17:05:13 devstack cinder-volume[94125]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Aug 26 17:05:13 devstack cinder-volume[94125]: WARNING oslo.privsep.daemon [-] privsep log: 
Aug 26 17:05:13 devstack cinder-volume[94125]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Aug 26 17:05:13 devstack cinder-volume[94125]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Aug 26 17:05:13 devstack cinder-volume[94125]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 26 17:05:13 devstack cinder-volume[94125]: WARNING oslo.privsep.daemon [-] privsep log: 
Aug 26 17:05:13 devstack cinder-volume[94125]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Aug 26 17:05:13 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5b625e92-1942-4961-a343-d7798d32383f 1073741824" returned: 0 in 1.214s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5b625e92-1942-4961-a343-d7798d32383f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:13 devstack sudo[96024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5b625e92-1942-4961-a343-d7798d32383f
Aug 26 17:05:13 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:14 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5b625e92-1942-4961-a343-d7798d32383f" returned: 0 in 0.393s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:05:14 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:14 devstack cinder-volume[94125]: INFO oslo.privsep.daemon [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Spawned new privsep daemon via rootwrap
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Accepted privsep connection to /tmp/tmpywlhl98k/privsep.sock {{(pid=94125) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2318c3a8-d8e3-48db-99a3-c80d166d01f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b625e92-1942-4961-a343-d7798d32383f', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969eca70-a4d1-4e3d-a0b5-c606413cc9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:05:14 devstack cinder-volume[94125]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 17:05:14 devstack cinder-volume[94125]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 17:05:14 devstack cinder-volume[94125]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 17:05:14 devstack cinder-volume[94125]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 96023
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db67f59-fd34-421a-a9ab-650850941c8e]: (2,) {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:05:14 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Volume volume-5b625e92-1942-4961-a343-d7798d32383f (5b625e92-1942-4961-a343-d7798d32383f): created successfully
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969eca70-a4d1-4e3d-a0b5-c606413cc9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Flow 'volume_create_manager' (0375bb10-75fd-4d4e-9928-7540f139ab05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c87b2e-5ab2-4f5e-a44a-c68fb3fa86ce]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-13959bb9-428c-423e-8b51-f58b1bd4f577 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:14 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5e9d73f1-2afc-47c6-af94-ea538bdbc974 tempest-VolumesAdminNegativeTest-1550544531 None] Created volume successfully.
Aug 26 17:05:14 devstack sudo[96028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-13959bb9-428c-423e-8b51-f58b1bd4f577
Aug 26 17:05:14 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Flow 'volume_create_manager' (2616889b-b1a8-425c-b546-543403049e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf80b1b-c0c5-42e0-a42e-141bc519becc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf80b1b-c0c5-42e0-a42e-141bc519becc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-213009093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94dd7f44-831d-4636-838c-60247565d1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7432730bb42b6b5a23ccd0f52800b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:05:15Z,use_quota=True,user_id='201e91e371b64229a33bf1e0b76c4461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb940dc7-3924-4992-b1fe-a1d3d6cba7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb940dc7-3924-4992-b1fe-a1d3d6cba7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6fceca-e39b-4831-af52-c140ec2f1ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6fceca-e39b-4831-af52-c140ec2f1ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94dd7f44-831d-4636-838c-60247565d1b4', 'volume_name': 'volume-94dd7f44-831d-4636-838c-60247565d1b4', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d725bea-0312-4ee4-b06f-1405ba960855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d725bea-0312-4ee4-b06f-1405ba960855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8193764-c3f5-47ff-b698-d83f2930a1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:05:14 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Volume 94dd7f44-831d-4636-838c-60247565d1b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94dd7f44-831d-4636-838c-60247565d1b4', 'volume_size': 1}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-213009093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94dd7f44-831d-4636-838c-60247565d1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac7432730bb42b6b5a23ccd0f52800b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:05:15Z,use_quota=True,user_id='201e91e371b64229a33bf1e0b76c4461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:05:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Creating volume 94dd7f44-831d-4636-838c-60247565d1b4 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:05:15 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-94dd7f44-831d-4636-838c-60247565d1b4 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:15 devstack sudo[96033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-94dd7f44-831d-4636-838c-60247565d1b4 1073741824
Aug 26 17:05:15 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:15 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-13959bb9-428c-423e-8b51-f58b1bd4f577" returned: 0 in 0.901s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-13959bb9-428c-423e-8b51-f58b1bd4f577 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:15 devstack sudo[96036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-13959bb9-428c-423e-8b51-f58b1bd4f577
Aug 26 17:05:15 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:15 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-13959bb9-428c-423e-8b51-f58b1bd4f577" returned: 0 in 0.389s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Lock "cinder-quobyte-13959bb9-428c-423e-8b51-f58b1bd4f577" released by "delete_volume" :: held 4.001s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:05:15 devstack cinder-volume[94125]: WARNING cinder.quota [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:05:15 devstack cinder-volume[94125]: WARNING cinder.quota [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Created reservations ['b22a91b3-3aed-4269-a820-645ac08dd1a6', '8a28a5fb-6936-4319-ac59-3d68490bee84', 'ca02f390-d6ea-4d37-addf-d92a7f3b93cd', '3090d8e5-1c8c-4802-8baa-e1046fe24886'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:05:15 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-94dd7f44-831d-4636-838c-60247565d1b4 1073741824" returned: 0 in 0.954s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:05:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:05:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:05:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:05:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:05:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:16 devstack sudo[96047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:05:16 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-94dd7f44-831d-4636-838c-60247565d1b4 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:16 devstack sudo[96049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-94dd7f44-831d-4636-838c-60247565d1b4
Aug 26 17:05:16 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Acquiring lock "cinder-5b625e92-1942-4961-a343-d7798d32383f-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:05:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Lock "cinder-5b625e92-1942-4961-a343-d7798d32383f-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:05:16 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.579s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:16 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:05:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Acquiring lock "cinder-quobyte-5b625e92-1942-4961-a343-d7798d32383f" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:05:16 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Deleted volume successfully.
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Lock "cinder-quobyte-5b625e92-1942-4961-a343-d7798d32383f" acquired by "delete_volume" :: waited 0.070s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-83c787c1-2ff9-4865-a9fe-827e013984c2 tempest-DeleteServersTestJSON-247740993 None] Lock "cinder-13959bb9-428c-423e-8b51-f58b1bd4f577-delete_volume" released by "delete_volume" :: held 5.682s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd9d231-079b-47d9-9fc4-436655d24039]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5b625e92-1942-4961-a343-d7798d32383f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:17 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-94dd7f44-831d-4636-838c-60247565d1b4" returned: 0 in 0.776s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] <== create_volume: return (2227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8193764-c3f5-47ff-b698-d83f2930a1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94dd7f44-831d-4636-838c-60247565d1b4', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a285f1-df71-457c-b8cf-abec9f5ee868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:05:17 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Volume volume-94dd7f44-831d-4636-838c-60247565d1b4 (94dd7f44-831d-4636-838c-60247565d1b4): created successfully
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a285f1-df71-457c-b8cf-abec9f5ee868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Flow 'volume_create_manager' (2616889b-b1a8-425c-b546-543403049e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:05:17 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8c6233d3-dcd5-43a7-a02e-2abd67688d07 tempest-ServerRescueNegativeTestJSON-85723646 None] Created volume successfully.
Aug 26 17:05:17 devstack sudo[96053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5b625e92-1942-4961-a343-d7798d32383f
Aug 26 17:05:17 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:17 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5b625e92-1942-4961-a343-d7798d32383f" returned: 0 in 0.845s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5b625e92-1942-4961-a343-d7798d32383f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:18 devstack sudo[96059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5b625e92-1942-4961-a343-d7798d32383f
Aug 26 17:05:18 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:18 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5b625e92-1942-4961-a343-d7798d32383f" returned: 0 in 0.592s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Lock "cinder-quobyte-5b625e92-1942-4961-a343-d7798d32383f" released by "delete_volume" :: held 1.552s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:05:18 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Created reservations ['2dda08f8-00fb-4d70-b68b-36c84dd56f75', '4bdc1fd7-d126-4eeb-add9-8118402d663d', '4792e406-f08f-49a0-9775-a205c1cc5a90', 'ebca5439-e867-4ebe-af1a-3a770f8661b3'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:05:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:05:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:05:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:05:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:05:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:05:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:18 devstack sudo[96063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:05:18 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:19 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.524s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:19 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:05:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Deleted volume successfully.
Aug 26 17:05:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bdf31101-406f-4051-9582-cd3b3b96c294 tempest-VolumesAdminNegativeTest-1550544531 None] Lock "cinder-5b625e92-1942-4961-a343-d7798d32383f-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:05:28 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=16,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:05:29 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=20,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=4 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:05:52 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:05:52 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:05:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Acquiring lock "cinder-94dd7f44-831d-4636-838c-60247565d1b4-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:05:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Lock "cinder-94dd7f44-831d-4636-838c-60247565d1b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:05:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Acquiring lock "cinder-quobyte-94dd7f44-831d-4636-838c-60247565d1b4" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:05:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Lock "cinder-quobyte-94dd7f44-831d-4636-838c-60247565d1b4" acquired by "delete_volume" :: waited 0.042s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:05:54 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb88e3c-a189-458d-b2bf-cc3d7489f448]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:05:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-94dd7f44-831d-4636-838c-60247565d1b4 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:55 devstack sudo[96286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-94dd7f44-831d-4636-838c-60247565d1b4
Aug 26 17:05:55 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:55 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-94dd7f44-831d-4636-838c-60247565d1b4" returned: 0 in 0.768s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-94dd7f44-831d-4636-838c-60247565d1b4 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:55 devstack sudo[96295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-94dd7f44-831d-4636-838c-60247565d1b4
Aug 26 17:05:55 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:55 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-94dd7f44-831d-4636-838c-60247565d1b4" returned: 0 in 0.437s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Lock "cinder-quobyte-94dd7f44-831d-4636-838c-60247565d1b4" released by "delete_volume" :: held 1.314s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:05:56 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Created reservations ['dfe13db8-12ee-4879-aea0-57ee418542f2', '40744b28-2e0e-4eb4-bc8d-52bfc10cea82', '715b4fe6-ce77-4bef-9b21-9645546ac2de', '6e901502-fdb9-4044-92ee-7da061628c5c'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:05:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:05:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:05:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:05:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:05:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:05:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:05:56 devstack sudo[96300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:05:56 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:05:56 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root
Aug 26 17:05:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.394s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:05:56 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:05:56 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Deleted volume successfully.
Aug 26 17:05:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9ebe53eb-6ebe-49ef-8f90-ec26d90708bd tempest-ServerRescueNegativeTestJSON-85723646 None] Lock "cinder-94dd7f44-831d-4636-838c-60247565d1b4-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:06:04 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-fb3570c6-8a3c-486f-a206-0994dafcc071 tempest-GroupSnapshotsTest-1709645379 None] Group tempest-GroupSnapshotsTest-Group-948352281: creating
Aug 26 17:06:04 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-fb3570c6-8a3c-486f-a206-0994dafcc071 tempest-GroupSnapshotsTest-1709645379 None] Group tempest-GroupSnapshotsTest-Group-948352281: created successfully
Aug 26 17:06:04 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-fb3570c6-8a3c-486f-a206-0994dafcc071 tempest-GroupSnapshotsTest-1709645379 None] Create group completed successfully.
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Flow 'volume_create_manager' (3fdeb7be-90f5-4fa6-8cbf-1a267db63c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5ccb1c-9405-41df-81dc-3970793d6936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5ccb1c-9405-41df-81dc-3970793d6936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1481880537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=deec3a05-2f92-4acb-abc4-8de20f0942e6,host='devstack@QuobyteHD#QuobyteHD',id=2f5662d0-4efe-4333-bb5f-601d46048288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d39ed347fa4a47ad4e8e11cef5e971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:06:07Z,use_quota=True,user_id='b261c81bbc674b7b9fbe974e5d67eb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df8afeca-ddc7-4001-859e-41b19a43eab9),volume_type_id=df8afeca-ddc7-4001-859e-41b19a43eab9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d096f6b-b029-42d9-bb4b-6faea56f3660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d096f6b-b029-42d9-bb4b-6faea56f3660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2948bd3e-84d4-4d0e-9187-164405f0251e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2948bd3e-84d4-4d0e-9187-164405f0251e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f5662d0-4efe-4333-bb5f-601d46048288', 'volume_name': 'volume-2f5662d0-4efe-4333-bb5f-601d46048288', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca284d23-50f6-40ee-b4d3-dc1232c326aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca284d23-50f6-40ee-b4d3-dc1232c326aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105b8f8f-4872-4497-aca4-3c7afc5fdb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:06 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Volume 2f5662d0-4efe-4333-bb5f-601d46048288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f5662d0-4efe-4333-bb5f-601d46048288', 'volume_size': 1}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=deec3a05-2f92-4acb-abc4-8de20f0942e6,created_at=2026-08-26T15:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1481880537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=deec3a05-2f92-4acb-abc4-8de20f0942e6,host='devstack@QuobyteHD#QuobyteHD',id=2f5662d0-4efe-4333-bb5f-601d46048288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d39ed347fa4a47ad4e8e11cef5e971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:06:07Z,use_quota=True,user_id='b261c81bbc674b7b9fbe974e5d67eb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df8afeca-ddc7-4001-859e-41b19a43eab9),volume_type_id=df8afeca-ddc7-4001-859e-41b19a43eab9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Creating volume 2f5662d0-4efe-4333-bb5f-601d46048288 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:06:06 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:06:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:06 devstack sudo[96449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 1073741824
Aug 26 17:06:06 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:07 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 1073741824" returned: 0 in 0.837s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:07 devstack sudo[96483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288
Aug 26 17:06:07 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:08 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288" returned: 0 in 0.481s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:06:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105b8f8f-4872-4497-aca4-3c7afc5fdb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f5662d0-4efe-4333-bb5f-601d46048288', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348f8a61-0def-4e50-b5dd-1c7c9e97821e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:08 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Volume volume-2f5662d0-4efe-4333-bb5f-601d46048288 (2f5662d0-4efe-4333-bb5f-601d46048288): created successfully
Aug 26 17:06:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348f8a61-0def-4e50-b5dd-1c7c9e97821e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Flow 'volume_create_manager' (3fdeb7be-90f5-4fa6-8cbf-1a267db63c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:06:08 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2ce5ba13-8d1e-4f1f-b2e5-7a3f2ba89132 tempest-GroupSnapshotsTest-1709645379 None] Created volume successfully.
Aug 26 17:06:10 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] GroupSnapshot 845301b1-245f-40c4-b323-d7bfd13ba543: creating.
Aug 26 17:06:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] Group snapshot 845301b1-245f-40c4-b323-d7bfd13ba543: creating. {{(pid=94125) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 26 17:06:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] Creating offline snapshot c676cc0e-f8f5-4629-8641-9416a37c0464 of volume 2f5662d0-4efe-4333-bb5f-601d46048288 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:06:10 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7418f0-2d4e-4aad-96b3-64b86c8e5905]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:10 devstack sudo[96519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288
Aug 26 17:06:10 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:10 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288" returned: 0 in 0.588s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:10 devstack sudo[96525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464 1G
Aug 26 17:06:10 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:11 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464 1G" returned: 0 in 0.483s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f5662d0-4efe-4333-bb5f-601d46048288 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:11 devstack sudo[96532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f5662d0-4efe-4333-bb5f-601d46048288 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464
Aug 26 17:06:11 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:11 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f5662d0-4efe-4333-bb5f-601d46048288 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464" returned: 0 in 0.459s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:11 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464 is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:06:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:11 devstack sudo[96538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464
Aug 26 17:06:11 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:11 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:06:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Flow 'volume_create_manager' (a17de7d1-abbd-4861-af78-557c080c1a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef2f124-3a37-4d10-b8cb-a1aa953ac69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef2f124-3a37-4d10-b8cb-a1aa953ac69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-802860252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1590c216-15ca-45a6-964c-5a2137520ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e162064aa1154806b28b49dc78b51336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:06:12Z,use_quota=True,user_id='515eca87302d44a6b8ea7309f609adf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eebd8b6f-a98b-41b5-a227-1dccbe019743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eebd8b6f-a98b-41b5-a227-1dccbe019743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2d74d3-6d87-4539-ae82-9c2705915463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2d74d3-6d87-4539-ae82-9c2705915463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1590c216-15ca-45a6-964c-5a2137520ff9', 'volume_name': 'volume-1590c216-15ca-45a6-964c-5a2137520ff9', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7862aae1-86d0-4261-9304-310004bc7343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7862aae1-86d0-4261-9304-310004bc7343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674d8ec4-9e00-4277-b4ea-24738f008e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Volume 1590c216-15ca-45a6-964c-5a2137520ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1590c216-15ca-45a6-964c-5a2137520ff9', 'volume_size': 1}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:12 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464" returned: 0 in 0.372s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:12 devstack sudo[96541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.info
Aug 26 17:06:12 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:12 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.info" returned: 0 in 0.313s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:12 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:12 devstack sudo[96544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.info
Aug 26 17:06:12 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:12 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.info" returned: 0 in 0.341s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.663s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-802860252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1590c216-15ca-45a6-964c-5a2137520ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e162064aa1154806b28b49dc78b51336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:06:12Z,use_quota=True,user_id='515eca87302d44a6b8ea7309f609adf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Creating volume 1590c216-15ca-45a6-964c-5a2137520ff9 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:06:12 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:06:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1590c216-15ca-45a6-964c-5a2137520ff9 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:12 devstack sudo[96548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1590c216-15ca-45a6-964c-5a2137520ff9 1073741824
Aug 26 17:06:12 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:13 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f84b59b9-ab5e-4bd3-ad87-98d963ff437d tempest-GroupSnapshotsTest-1709645379 None] group_snapshot 845301b1-245f-40c4-b323-d7bfd13ba543: created successfully
Aug 26 17:06:13 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1590c216-15ca-45a6-964c-5a2137520ff9 1073741824" returned: 0 in 0.620s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1590c216-15ca-45a6-964c-5a2137520ff9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:13 devstack sudo[96555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1590c216-15ca-45a6-964c-5a2137520ff9
Aug 26 17:06:13 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:14 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1590c216-15ca-45a6-964c-5a2137520ff9" returned: 0 in 0.483s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:06:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674d8ec4-9e00-4277-b4ea-24738f008e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1590c216-15ca-45a6-964c-5a2137520ff9', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c71d76a-f7ea-447f-81c0-218cba99faea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:14 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Volume volume-1590c216-15ca-45a6-964c-5a2137520ff9 (1590c216-15ca-45a6-964c-5a2137520ff9): created successfully
Aug 26 17:06:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c71d76a-f7ea-447f-81c0-218cba99faea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Flow 'volume_create_manager' (a17de7d1-abbd-4861-af78-557c080c1a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:06:14 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-912b3c8a-f187-4203-b982-2661e8381a8d tempest-TaggedAttachmentsTest-1904648988 None] Created volume successfully.
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-c676cc0e-f8f5-4629-8641-9416a37c0464-58a5023f-0d50-4588-b878-a549ba180574" by "_create_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-c676cc0e-f8f5-4629-8641-9416a37c0464-58a5023f-0d50-4588-b878-a549ba180574" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Creating volume 58a5023f-0d50-4588-b878-a549ba180574 from snapshot c676cc0e-f8f5-4629-8641-9416a37c0464 {{(pid=94125) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-58a5023f-0d50-4588-b878-a549ba180574" by "_copy_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-58a5023f-0d50-4588-b878-a549ba180574" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] snapshot: c676cc0e-f8f5-4629-8641-9416a37c0464, volume: 58a5023f-0d50-4588-b878-a549ba180574,  {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf6e719-09c2-453f-9f62-f2bba2000991]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:15 devstack sudo[96562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464
Aug 26 17:06:15 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:15 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464" returned: 0 in 0.644s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f5662d0-4efe-4333-bb5f-601d46048288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c62ac82-792a-43ec-98d8-4280767ff8ac]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:16 devstack sudo[96568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288
Aug 26 17:06:16 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:16 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288" returned: 0 in 0.408s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 26 17:06:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Creating direct copy from snapshot {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 26 17:06:16 devstack cinder-volume[94125]: DEBUG cinder.utils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Path /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574 not found in is_blk_device check {{(pid=94125) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 26 17:06:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:16 devstack sudo[96574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574
Aug 26 17:06:16 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574" returned: 0 in 6.507s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:22 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288, size 1024.00 MB, duration 6.51 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:06:22 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Converted 1024.00 MB image at 157.31 MB/s
Aug 26 17:06:22 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574 is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:06:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:22 devstack sudo[96624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574
Aug 26 17:06:22 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:23 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574" returned: 0 in 0.259s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:23 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-58a5023f-0d50-4588-b878-a549ba180574" released by "_copy_volume_from_snapshot" :: held 7.983s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:06:23 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-c676cc0e-f8f5-4629-8641-9416a37c0464-58a5023f-0d50-4588-b878-a549ba180574" released by "_create_volume_from_snapshot" :: held 8.084s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:06:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.125s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:23 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-44ebfc91-0f25-4e03-b430-7f44dbe7e4ca tempest-GroupSnapshotsTest-1709645379 None] Create group from source-snapshot-845301b1-245f-40c4-b323-d7bfd13ba543 completed successfully.
Aug 26 17:06:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-58a5023f-0d50-4588-b878-a549ba180574" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:06:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-58a5023f-0d50-4588-b878-a549ba180574" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:06:24 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7b9c9a-3377-4101-937c-df6d47c688d9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:25 devstack sudo[96632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574
Aug 26 17:06:25 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:25 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574" returned: 0 in 0.488s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:25 devstack sudo[96651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574
Aug 26 17:06:25 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:25 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-58a5023f-0d50-4588-b878-a549ba180574" returned: 0 in 0.386s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-58a5023f-0d50-4588-b878-a549ba180574" released by "delete_volume" :: held 0.978s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:06:25 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['5a86c624-dad1-449b-ba7c-628dfd3df9a1'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:06:25 devstack cinder-volume[94125]: WARNING cinder.quota [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2007269340 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2007269340, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:06:25 devstack cinder-volume[94125]: WARNING cinder.quota [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2007269340 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2007269340, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['3a81fb44-0c5f-4485-a332-23fdbeb5fbda', 'd6733ffa-a4bf-4808-a0fb-951552a2904c', '684db866-d493-4c97-80b5-25f3ac4888cf', '29f329ba-c994-4789-bc22-cbe6a0175b15'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:26 devstack sudo[96662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:06:26 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:26 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] group_snapshot 845301b1-245f-40c4-b323-d7bfd13ba543: deleting
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] group_snapshot 845301b1-245f-40c4-b323-d7bfd13ba543: deleting {{(pid=94125) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-2f5662d0-4efe-4333-bb5f-601d46048288" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-2f5662d0-4efe-4333-bb5f-601d46048288" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-c676cc0e-f8f5-4629-8641-9416a37c0464" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-c676cc0e-f8f5-4629-8641-9416a37c0464" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Deleting offline snapshot c676cc0e-f8f5-4629-8641-9416a37c0464 of volume 2f5662d0-4efe-4333-bb5f-601d46048288 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:06:26 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] snapshot_file for this snap is: volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.397s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:06:26 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-bee99545-ccd9-4558-b9b5-27b25cf80b42 tempest-GroupSnapshotsTest-1709645379 None] Delete group completed successfully.
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a0dfea-5bc6-41eb-b049-4709f889aeb9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:26 devstack sudo[96671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464
Aug 26 17:06:26 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:27 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464" returned: 0 in 0.415s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f5662d0-4efe-4333-bb5f-601d46048288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:06:27 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a5f7b9-8738-46e3-b80f-d3cfa20f7b74]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:27 devstack sudo[96677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288
Aug 26 17:06:27 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:27 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288" returned: 0 in 0.673s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:27 devstack sudo[96684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464
Aug 26 17:06:27 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:28 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464" returned: 0 in 0.532s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:28 devstack sudo[96694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464
Aug 26 17:06:28 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:28 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288.c676cc0e-f8f5-4629-8641-9416a37c0464" returned: 0 in 0.737s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-c676cc0e-f8f5-4629-8641-9416a37c0464" released by "_delete_snapshot" :: held 2.488s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:06:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-2f5662d0-4efe-4333-bb5f-601d46048288" released by "delete_snapshot" :: held 2.520s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:06:29 devstack cinder-volume[94125]: WARNING cinder.quota [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2007269340 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2007269340, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:06:29 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['7753e55b-4c3c-4ceb-b23a-a163da536131', '7fd4b63a-c5ff-463f-be75-ac31b3d88074', '5a01cb9b-5bf1-458a-999d-f7ac59941452', '56270463-00c9-48c7-b882-902ff272a857'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:06:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-72c03ca8-d226-4c9e-9b92-de6b923a92c0 tempest-GroupSnapshotsTest-1709645379 None] group_snapshot 845301b1-245f-40c4-b323-d7bfd13ba543: deleted successfully
Aug 26 17:06:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-2f5662d0-4efe-4333-bb5f-601d46048288" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:06:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-2f5662d0-4efe-4333-bb5f-601d46048288" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:06:30 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[530a4f12-398e-4c69-a5e9-c8ece57fc0e9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:30 devstack sudo[96755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288
Aug 26 17:06:30 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:31 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288" returned: 0 in 0.595s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:31 devstack sudo[96781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288
Aug 26 17:06:31 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:31 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2f5662d0-4efe-4333-bb5f-601d46048288" returned: 0 in 0.295s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-2f5662d0-4efe-4333-bb5f-601d46048288" released by "delete_volume" :: held 0.986s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['7644c557-c3b3-4dbd-822c-cf61ab37b007'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:06:31 devstack cinder-volume[94125]: WARNING cinder.db.api [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2007269340']
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['e2023ef8-decc-4b55-892e-8ae4c6170cc0', '949c1370-af9e-451d-a100-1e133a2d2f28', '97cb9b02-5012-4fba-b528-cef36b4b509f', '812015ca-68eb-4d4b-95a3-f627ce3df7cd'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:31 devstack sudo[96785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:06:31 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:31 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.277s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:31 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:06:31 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-72de2204-9f72-40e2-950b-5566f0c576ea tempest-GroupSnapshotsTest-1709645379 None] Delete group completed successfully.
Aug 26 17:06:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f751a881-d0ff-4d9e-a525-6857a86e704c tempest-GroupSnapshotsTest-1709645379 None] Group tempest-GroupSnapshotsTest-Group-1038932166: creating
Aug 26 17:06:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f751a881-d0ff-4d9e-a525-6857a86e704c tempest-GroupSnapshotsTest-1709645379 None] Group tempest-GroupSnapshotsTest-Group-1038932166: created successfully
Aug 26 17:06:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f751a881-d0ff-4d9e-a525-6857a86e704c tempest-GroupSnapshotsTest-1709645379 None] Create group completed successfully.
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Flow 'volume_create_manager' (3e72c38b-608e-4678-9159-feecbd751293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985268f0-6180-43f3-b918-2e2d65dd271d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985268f0-6180-43f3-b918-2e2d65dd271d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-122737892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dca1d2e-0279-4b3a-8898-4d8b28ff73fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f907ea43038c45a79aa0a852f1e85df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:06:36Z,use_quota=True,user_id='576b0fd7fd2c48dca60883871faf1154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e21471-7527-4ade-b444-041116c997da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e21471-7527-4ade-b444-041116c997da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924ef858-c727-40e6-a41b-17b698aff04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924ef858-c727-40e6-a41b-17b698aff04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dca1d2e-0279-4b3a-8898-4d8b28ff73fd', 'volume_name': 'volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0807b0-dcc8-499a-ba97-30ae93a9d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0807b0-dcc8-499a-ba97-30ae93a9d863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140230fc-b79a-4bf1-abee-0e9e5d2c5097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:35 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Volume 8dca1d2e-0279-4b3a-8898-4d8b28ff73fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd', 'volume_size': 1}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-122737892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dca1d2e-0279-4b3a-8898-4d8b28ff73fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f907ea43038c45a79aa0a852f1e85df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:06:36Z,use_quota=True,user_id='576b0fd7fd2c48dca60883871faf1154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Creating volume 8dca1d2e-0279-4b3a-8898-4d8b28ff73fd {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:06:35 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:35 devstack sudo[96795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd 1073741824
Aug 26 17:06:35 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Flow 'volume_create_manager' (75ce47b3-8a80-4c38-9d6c-47dc723855d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:06:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90385923-f2ee-4d35-8490-dc530bba7947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90385923-f2ee-4d35-8490-dc530bba7947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1249744936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c1708e1e-bdb4-4834-8b94-41b1b0f86f03,host='devstack@QuobyteHD#QuobyteHD',id=22ca1d12-a3d3-4c0e-abd5-1642572788c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d39ed347fa4a47ad4e8e11cef5e971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:06:36Z,use_quota=True,user_id='b261c81bbc674b7b9fbe974e5d67eb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e23012a2-8ac7-43ee-bf50-130a234dfe26),volume_type_id=e23012a2-8ac7-43ee-bf50-130a234dfe26)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715c1369-593b-4a75-af27-db43ca2e1120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715c1369-593b-4a75-af27-db43ca2e1120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6df3ea-aea4-45e9-b85e-c8e011187c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6df3ea-aea4-45e9-b85e-c8e011187c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ca1d12-a3d3-4c0e-abd5-1642572788c3', 'volume_name': 'volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc972b62-88e5-4ab1-ad47-a0aee5b0c490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc972b62-88e5-4ab1-ad47-a0aee5b0c490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f484bb-2d6f-4754-9dda-1ddbb27b0ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:36 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Volume 22ca1d12-a3d3-4c0e-abd5-1642572788c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3', 'volume_size': 1}
Aug 26 17:06:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:36 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd 1073741824" returned: 0 in 0.671s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:36 devstack sudo[96802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd
Aug 26 17:06:36 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:37 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd" returned: 0 in 0.464s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c1708e1e-bdb4-4834-8b94-41b1b0f86f03,created_at=2026-08-26T15:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1249744936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c1708e1e-bdb4-4834-8b94-41b1b0f86f03,host='devstack@QuobyteHD#QuobyteHD',id=22ca1d12-a3d3-4c0e-abd5-1642572788c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d39ed347fa4a47ad4e8e11cef5e971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:06:36Z,use_quota=True,user_id='b261c81bbc674b7b9fbe974e5d67eb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e23012a2-8ac7-43ee-bf50-130a234dfe26),volume_type_id=e23012a2-8ac7-43ee-bf50-130a234dfe26)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Creating volume 22ca1d12-a3d3-4c0e-abd5-1642572788c3 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:06:37 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140230fc-b79a-4bf1-abee-0e9e5d2c5097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545d7c49-b2c5-4437-ba12-69c824f02946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:37 devstack sudo[96805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3 1073741824
Aug 26 17:06:37 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:37 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Volume volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd (8dca1d2e-0279-4b3a-8898-4d8b28ff73fd): created successfully
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545d7c49-b2c5-4437-ba12-69c824f02946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Flow 'volume_create_manager' (3e72c38b-608e-4678-9159-feecbd751293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:06:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d1326ac7-593b-4575-8528-1708d9353d58 tempest-ServerActionsTestOtherA-673370039 None] Created volume successfully.
Aug 26 17:06:37 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3 1073741824" returned: 0 in 0.734s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:37 devstack sudo[96811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3
Aug 26 17:06:37 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:38 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3" returned: 0 in 0.641s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:06:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f484bb-2d6f-4754-9dda-1ddbb27b0ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd33a83-c0f5-4435-b693-d6c3cb66e3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:38 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Volume volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3 (22ca1d12-a3d3-4c0e-abd5-1642572788c3): created successfully
Aug 26 17:06:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd33a83-c0f5-4435-b693-d6c3cb66e3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Flow 'volume_create_manager' (75ce47b3-8a80-4c38-9d6c-47dc723855d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:06:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-416556af-3730-466e-8c0f-a73c62c231d3 tempest-GroupSnapshotsTest-1709645379 None] Created volume successfully.
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Flow 'volume_create_manager' (2eac49dd-9d36-469e-a587-eefe7a1581b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3e33ef-2be2-4bcb-a003-1ab2a5e2e1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3e33ef-2be2-4bcb-a003-1ab2a5e2e1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-452588860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c1708e1e-bdb4-4834-8b94-41b1b0f86f03,host='devstack@QuobyteHD#QuobyteHD',id=8d870610-559a-46fa-bfbf-c0f1a7b6b682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d39ed347fa4a47ad4e8e11cef5e971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:06:41Z,use_quota=True,user_id='b261c81bbc674b7b9fbe974e5d67eb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e23012a2-8ac7-43ee-bf50-130a234dfe26),volume_type_id=e23012a2-8ac7-43ee-bf50-130a234dfe26)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fd133c-7a7f-4e5f-a2fb-1e92a1e06958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fd133c-7a7f-4e5f-a2fb-1e92a1e06958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd571305-5ac4-4470-9151-54cad6d72c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd571305-5ac4-4470-9151-54cad6d72c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d870610-559a-46fa-bfbf-c0f1a7b6b682', 'volume_name': 'volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649ca992-681e-4bd2-9f33-b1e6a5996411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649ca992-681e-4bd2-9f33-b1e6a5996411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de72d8a-ca01-4128-b20d-d368b2cef5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:40 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Volume 8d870610-559a-46fa-bfbf-c0f1a7b6b682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682', 'volume_size': 1}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c1708e1e-bdb4-4834-8b94-41b1b0f86f03,created_at=2026-08-26T15:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-452588860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c1708e1e-bdb4-4834-8b94-41b1b0f86f03,host='devstack@QuobyteHD#QuobyteHD',id=8d870610-559a-46fa-bfbf-c0f1a7b6b682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d39ed347fa4a47ad4e8e11cef5e971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:06:41Z,use_quota=True,user_id='b261c81bbc674b7b9fbe974e5d67eb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e23012a2-8ac7-43ee-bf50-130a234dfe26),volume_type_id=e23012a2-8ac7-43ee-bf50-130a234dfe26)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Creating volume 8d870610-559a-46fa-bfbf-c0f1a7b6b682 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:06:40 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:06:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:40 devstack sudo[96838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682 1073741824
Aug 26 17:06:40 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:41 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682 1073741824" returned: 0 in 0.692s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:41 devstack sudo[96844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682
Aug 26 17:06:41 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:41 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682" returned: 0 in 0.334s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:06:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de72d8a-ca01-4128-b20d-d368b2cef5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6150b9-6df4-46ae-8298-7718a7419de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:06:42 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Volume volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682 (8d870610-559a-46fa-bfbf-c0f1a7b6b682): created successfully
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6150b9-6df4-46ae-8298-7718a7419de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Flow 'volume_create_manager' (2eac49dd-9d36-469e-a587-eefe7a1581b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:06:42 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a1d564dc-9597-4458-b87b-fa316201e4ba tempest-GroupSnapshotsTest-1709645379 None] Created volume successfully.
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:42 devstack sudo[96848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:06:42 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:42 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.362s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 8 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:06:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:06:43 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-690d38fb-a229-443d-8ed3-ba5828719344 tempest-GroupSnapshotsTest-1709645379 None] Update group completed successfully.
Aug 26 17:06:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-146268e2-0947-406f-916e-2c450f744fb9 tempest-GroupSnapshotsTest-1709645379 None] Update group completed successfully.
Aug 26 17:06:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-28bae6e9-b5e0-4dd4-b927-3493f5348571 tempest-GroupSnapshotsTest-1709645379 None] Update group completed successfully.
Aug 26 17:06:47 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f61cae7d-ed6f-4e40-9ca4-e445f3cb67bd tempest-GroupSnapshotsTest-1709645379 None] Update group completed successfully.
Aug 26 17:06:49 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] GroupSnapshot 9a4a0ee0-a1dc-48ad-b13d-cd13f7de4381: creating.
Aug 26 17:06:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Group snapshot 9a4a0ee0-a1dc-48ad-b13d-cd13f7de4381: creating. {{(pid=94125) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 26 17:06:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Creating offline snapshot 68911531-21aa-48bf-84d1-3257bf851337 of volume 22ca1d12-a3d3-4c0e-abd5-1642572788c3 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:06:49 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2882e2c3-271b-498e-96e4-57a59c102ad8]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:49 devstack sudo[97017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3
Aug 26 17:06:49 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:50 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3" returned: 0 in 0.526s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:50 devstack sudo[97055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337 1G
Aug 26 17:06:50 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:50 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337 1G" returned: 0 in 0.490s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:50 devstack sudo[97063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337
Aug 26 17:06:50 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:50 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337" returned: 0 in 0.320s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:50 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337 is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:06:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:50 devstack sudo[97070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337
Aug 26 17:06:50 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:51 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337" returned: 0 in 0.461s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:51 devstack sudo[97076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.info
Aug 26 17:06:51 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:51 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.info" returned: 0 in 0.507s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:51 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:06:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:51 devstack sudo[97079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.info
Aug 26 17:06:51 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:52 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.info" returned: 0 in 0.281s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.738s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:06:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:06:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Creating offline snapshot afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e of volume 8d870610-559a-46fa-bfbf-c0f1a7b6b682 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:06:52 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a97c3d-441d-4364-80bc-bb6e71a813a9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:52 devstack sudo[97082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682
Aug 26 17:06:52 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:52 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682" returned: 0 in 0.602s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:52 devstack sudo[97087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e 1G
Aug 26 17:06:52 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:53 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e 1G" returned: 0 in 0.767s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:53 devstack sudo[97092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e
Aug 26 17:06:53 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:54 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e" returned: 0 in 0.685s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:54 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:06:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:54 devstack sudo[97098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e
Aug 26 17:06:54 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:54 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e" returned: 0 in 0.520s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:54 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=64,cinder:INSERT=12,cinder:UPDATE=68,cinder:DELETE=3 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:06:54 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=55,cinder:SELECT=66,cinder:INSERT=14,cinder:DELETE=3 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:06:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:54 devstack sudo[97103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.info
Aug 26 17:06:54 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:55 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.info" returned: 0 in 0.564s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:55 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:06:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:55 devstack sudo[97110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.info
Aug 26 17:06:55 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:55 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.info" returned: 0 in 0.481s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.802s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:06:56 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-fd2ef5de-8655-4243-bf03-d7d13f57d31c tempest-GroupSnapshotsTest-1709645379 None] group_snapshot 9a4a0ee0-a1dc-48ad-b13d-cd13f7de4381: created successfully
Aug 26 17:06:57 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] group_snapshot 9a4a0ee0-a1dc-48ad-b13d-cd13f7de4381: deleting
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] group_snapshot 9a4a0ee0-a1dc-48ad-b13d-cd13f7de4381: deleting {{(pid=94125) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-22ca1d12-a3d3-4c0e-abd5-1642572788c3" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-22ca1d12-a3d3-4c0e-abd5-1642572788c3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-68911531-21aa-48bf-84d1-3257bf851337" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-68911531-21aa-48bf-84d1-3257bf851337" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Deleting offline snapshot 68911531-21aa-48bf-84d1-3257bf851337 of volume 22ca1d12-a3d3-4c0e-abd5-1642572788c3 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] snapshot_file for this snap is: volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a8a772-c431-4068-8c97-40b3d769dab8]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:57 devstack sudo[97113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337
Aug 26 17:06:57 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:57 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337" returned: 0 in 0.438s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0500e4e-e106-4143-b090-0ce6b8769b2b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:57 devstack sudo[97118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3
Aug 26 17:06:57 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:58 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3" returned: 0 in 0.352s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:58 devstack sudo[97123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337
Aug 26 17:06:58 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:58 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337" returned: 0 in 0.329s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:58 devstack sudo[97128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337
Aug 26 17:06:58 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:58 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3.68911531-21aa-48bf-84d1-3257bf851337" returned: 0 in 0.239s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-68911531-21aa-48bf-84d1-3257bf851337" released by "_delete_snapshot" :: held 1.466s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-22ca1d12-a3d3-4c0e-abd5-1642572788c3" released by "delete_snapshot" :: held 1.499s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-8d870610-559a-46fa-bfbf-c0f1a7b6b682" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-8d870610-559a-46fa-bfbf-c0f1a7b6b682" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Deleting offline snapshot afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e of volume 8d870610-559a-46fa-bfbf-c0f1a7b6b682 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] snapshot_file for this snap is: volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81a68bf-8156-4522-93b3-05405b0e595e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:58 devstack sudo[97131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e
Aug 26 17:06:58 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:59 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e" returned: 0 in 0.393s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:06:59 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a8d330-a427-4480-966b-685038661911]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:06:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:59 devstack sudo[97138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682
Aug 26 17:06:59 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:06:59 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root
Aug 26 17:06:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682" returned: 0 in 0.468s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:06:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:06:59 devstack sudo[97144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e
Aug 26 17:06:59 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:00 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e" returned: 0 in 0.473s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:00 devstack sudo[97151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e
Aug 26 17:07:00 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:00 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682.afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e" returned: 0 in 0.308s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-afdf9d5c-7c0b-4a48-9ef0-bd61ef90079e" released by "_delete_snapshot" :: held 1.737s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:07:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-8d870610-559a-46fa-bfbf-c0f1a7b6b682" released by "delete_snapshot" :: held 1.767s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:07:00 devstack cinder-volume[94125]: WARNING cinder.quota [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1857963265 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1857963265, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:07:00 devstack cinder-volume[94125]: WARNING cinder.quota [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1857963265 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1857963265, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:07:00 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['431c8c40-5ff8-4bbf-aca0-27e60e36042c', '378c42a0-7ffc-4487-be08-edeb95a60edc', '28216b07-69f7-40b5-a3c2-fc6558313f53', '3dc4f830-bf42-490c-ad78-75f6e3a0b7de'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:00 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['96b875b4-9e08-40a5-ace3-80777ccd954f', '5a72094c-d567-4bb7-933b-b3f6e27e572c', 'a90bba5c-10a0-4d3e-a808-325a92272493', 'e39c0684-69fe-4775-bcce-e8a54fc6b5d4'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:01 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-58c0cd59-ee92-4052-a7c5-c5c7cc47ef73 tempest-GroupSnapshotsTest-1709645379 None] group_snapshot 9a4a0ee0-a1dc-48ad-b13d-cd13f7de4381: deleted successfully
Aug 26 17:07:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-22ca1d12-a3d3-4c0e-abd5-1642572788c3" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:07:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-22ca1d12-a3d3-4c0e-abd5-1642572788c3" acquired by "delete_volume" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:07:02 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5705daf6-b9ad-4aa1-b63b-d838b625845e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:07:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:02 devstack sudo[97155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3
Aug 26 17:07:02 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:03 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3" returned: 0 in 0.559s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:03 devstack sudo[97163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3
Aug 26 17:07:03 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:03 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-22ca1d12-a3d3-4c0e-abd5-1642572788c3" returned: 0 in 0.337s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-22ca1d12-a3d3-4c0e-abd5-1642572788c3" released by "delete_volume" :: held 0.988s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:07:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-8d870610-559a-46fa-bfbf-c0f1a7b6b682" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:07:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-8d870610-559a-46fa-bfbf-c0f1a7b6b682" acquired by "delete_volume" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:07:03 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71cfc33-2fc5-4683-83ec-97e98dc66f61]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:07:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:03 devstack sudo[97166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682
Aug 26 17:07:03 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682" returned: 0 in 0.760s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:04 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:04 devstack sudo[97189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682
Aug 26 17:07:04 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:04 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8d870610-559a-46fa-bfbf-c0f1a7b6b682" returned: 0 in 0.504s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-8d870610-559a-46fa-bfbf-c0f1a7b6b682" released by "delete_volume" :: held 1.354s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:07:05 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['6a8a5dd1-bcc9-4c8a-9a35-2d526ab8f770'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:05 devstack cinder-volume[94125]: WARNING cinder.quota [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1857963265 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1857963265, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:07:05 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['dbd6902e-c2a7-458d-bd42-37210075ce06', '68a70e97-88ab-43fb-8c37-e315d3211c83', 'b5c88a35-684b-4064-aee2-46ba23dfe1f0', '75fdd2aa-002c-4f8d-9f5b-bbe79a9107bb'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:05 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['ec8977ed-e962-4395-9617-61f2abd2dae9', '180cb2a7-e4dc-47a7-8161-a59b318ca32c', 'd4cb5840-f2ee-42d2-8b3f-c2dcd535e7db', 'bf4eda22-8f3b-42b2-8fbe-fdbcc33db1d1'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:07:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:07:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:05 devstack sudo[97256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:07:05 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:06 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.324s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:06 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:07:06 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c4a42cea-903d-41e6-95ad-f38f60b9f0a1 tempest-GroupSnapshotsTest-1709645379 None] Delete group completed successfully.
Aug 26 17:07:06 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4e91c212-250f-4b25-8288-5dbaf8c5c2ed tempest-GroupSnapshotsTest-1709645379 None] Group tempest-GroupSnapshotsTest-Group-252305628: creating
Aug 26 17:07:06 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4e91c212-250f-4b25-8288-5dbaf8c5c2ed tempest-GroupSnapshotsTest-1709645379 None] Group tempest-GroupSnapshotsTest-Group-252305628: created successfully
Aug 26 17:07:06 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4e91c212-250f-4b25-8288-5dbaf8c5c2ed tempest-GroupSnapshotsTest-1709645379 None] Create group completed successfully.
Aug 26 17:07:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-3a28b3bd-1a14-460f-9fc4-42a449f1a6ae req-4745ad12-6139-4f52-9835-208b1216fc7a tempest-TaggedAttachmentsTest-1904648988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-3a28b3bd-1a14-460f-9fc4-42a449f1a6ae req-4745ad12-6139-4f52-9835-208b1216fc7a tempest-TaggedAttachmentsTest-1904648988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-3a28b3bd-1a14-460f-9fc4-42a449f1a6ae req-4745ad12-6139-4f52-9835-208b1216fc7a tempest-TaggedAttachmentsTest-1904648988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-3a28b3bd-1a14-460f-9fc4-42a449f1a6ae req-4745ad12-6139-4f52-9835-208b1216fc7a tempest-TaggedAttachmentsTest-1904648988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-1590c216-15ca-45a6-964c-5a2137520ff9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82238fbb-c5af-4d94-b266-7dd9b2fce124', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:07:07 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-3a28b3bd-1a14-460f-9fc4-42a449f1a6ae req-4745ad12-6139-4f52-9835-208b1216fc7a tempest-TaggedAttachmentsTest-1904648988 None] attachment_update completed successfully.
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Flow 'volume_create_manager' (ac1cf704-5d1c-4208-a997-38f0bc61d683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7cb35d-552d-4811-ae90-1dd19a8c324a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7cb35d-552d-4811-ae90-1dd19a8c324a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1564986037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=145ff4a1-8153-42a6-b386-87d02ef1cbf0,host='devstack@QuobyteHD#QuobyteHD',id=9621f4e8-3cb1-45cc-9777-8d3572a2d00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d39ed347fa4a47ad4e8e11cef5e971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:07:08Z,use_quota=True,user_id='b261c81bbc674b7b9fbe974e5d67eb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b053f8-2923-4630-8d09-9091b0f353c8),volume_type_id=03b053f8-2923-4630-8d09-9091b0f353c8)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f50a775-1151-4437-81cd-c32941cadd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f50a775-1151-4437-81cd-c32941cadd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a90b3f-a8c5-489c-a429-c694d1e537cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a90b3f-a8c5-489c-a429-c694d1e537cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9621f4e8-3cb1-45cc-9777-8d3572a2d00f', 'volume_name': 'volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94591f3c-dc1e-42a8-b7e8-9902728f49b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94591f3c-dc1e-42a8-b7e8-9902728f49b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27df261-b4c6-461c-a79e-b3fd084f52cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:08 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Volume 9621f4e8-3cb1-45cc-9777-8d3572a2d00f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f', 'volume_size': 1}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=145ff4a1-8153-42a6-b386-87d02ef1cbf0,created_at=2026-08-26T15:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1564986037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=145ff4a1-8153-42a6-b386-87d02ef1cbf0,host='devstack@QuobyteHD#QuobyteHD',id=9621f4e8-3cb1-45cc-9777-8d3572a2d00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d39ed347fa4a47ad4e8e11cef5e971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:07:08Z,use_quota=True,user_id='b261c81bbc674b7b9fbe974e5d67eb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03b053f8-2923-4630-8d09-9091b0f353c8),volume_type_id=03b053f8-2923-4630-8d09-9091b0f353c8)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Creating volume 9621f4e8-3cb1-45cc-9777-8d3572a2d00f {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:07:08 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:08 devstack sudo[97695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f 1073741824
Aug 26 17:07:08 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:08 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f 1073741824" returned: 0 in 0.416s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:08 devstack sudo[97703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f
Aug 26 17:07:08 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:08 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f" returned: 0 in 0.240s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27df261-b4c6-461c-a79e-b3fd084f52cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a86d5b-2c8c-40b9-a7e6-9dc6e7ec5e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:08 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Volume volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f (9621f4e8-3cb1-45cc-9777-8d3572a2d00f): created successfully
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a86d5b-2c8c-40b9-a7e6-9dc6e7ec5e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Flow 'volume_create_manager' (ac1cf704-5d1c-4208-a997-38f0bc61d683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:07:08 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e924200f-eb78-434e-8184-9fda9e8e55ee tempest-GroupSnapshotsTest-1709645379 None] Created volume successfully.
Aug 26 17:07:09 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] GroupSnapshot b5d8b79b-d5f8-4a3d-b54d-ab239f9082a8: creating.
Aug 26 17:07:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] Group snapshot b5d8b79b-d5f8-4a3d-b54d-ab239f9082a8: creating. {{(pid=94125) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 26 17:07:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] Creating offline snapshot 4f5e458a-9d56-4e6a-bce4-29958400223e of volume 9621f4e8-3cb1-45cc-9777-8d3572a2d00f {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:07:09 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2c95c2-a971-4ae2-b34b-5bf7e6dfc89c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:07:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:09 devstack sudo[97710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f
Aug 26 17:07:09 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:10 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f" returned: 0 in 0.413s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:10 devstack sudo[97716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e 1G
Aug 26 17:07:10 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:10 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-1855edca-ecbf-4c33-83cb-8432b044b5de req-485a1475-e93a-4a3b-86ca-89d9eeb513ba tempest-TaggedAttachmentsTest-1904648988 None] Terminate volume connection completed successfully.
Aug 26 17:07:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-1855edca-ecbf-4c33-83cb-8432b044b5de req-485a1475-e93a-4a3b-86ca-89d9eeb513ba tempest-TaggedAttachmentsTest-1904648988 None] Deleting attachment 82238fbb-c5af-4d94-b266-7dd9b2fce124. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:07:10 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e 1G" returned: 0 in 0.457s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:10 devstack sudo[97752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e
Aug 26 17:07:10 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:10 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e" returned: 0 in 0.296s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:10 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:07:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:10 devstack sudo[97757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e
Aug 26 17:07:10 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:11 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e" returned: 0 in 0.277s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:11 devstack sudo[97761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.info
Aug 26 17:07:11 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:11 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.info" returned: 0 in 0.369s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:11 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:07:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:11 devstack sudo[97766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.info
Aug 26 17:07:11 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:11 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.info" returned: 0 in 0.420s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:12 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2ff60379-0d5b-4e31-b8b3-b7f28cdebe78 tempest-GroupSnapshotsTest-1709645379 None] group_snapshot b5d8b79b-d5f8-4a3d-b54d-ab239f9082a8: created successfully
Aug 26 17:07:13 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] group_snapshot b5d8b79b-d5f8-4a3d-b54d-ab239f9082a8: deleting
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] group_snapshot b5d8b79b-d5f8-4a3d-b54d-ab239f9082a8: deleting {{(pid=94125) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-9621f4e8-3cb1-45cc-9777-8d3572a2d00f" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-9621f4e8-3cb1-45cc-9777-8d3572a2d00f" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-4f5e458a-9d56-4e6a-bce4-29958400223e" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-4f5e458a-9d56-4e6a-bce4-29958400223e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Deleting offline snapshot 4f5e458a-9d56-4e6a-bce4-29958400223e of volume 9621f4e8-3cb1-45cc-9777-8d3572a2d00f {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] snapshot_file for this snap is: volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5198fb8a-0ed9-4172-8673-c7b525b02c3d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:13 devstack sudo[97787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e
Aug 26 17:07:13 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:13 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e" returned: 0 in 0.453s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bb2ef4-f4c9-4e0a-8694-1b37038f24c0]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:07:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:13 devstack sudo[97792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f
Aug 26 17:07:13 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:14 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f" returned: 0 in 0.517s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:14 devstack sudo[97799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e
Aug 26 17:07:14 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:14 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e" returned: 0 in 0.565s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:14 devstack sudo[97814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e
Aug 26 17:07:14 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:15 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f.4f5e458a-9d56-4e6a-bce4-29958400223e" returned: 0 in 0.413s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-4f5e458a-9d56-4e6a-bce4-29958400223e" released by "_delete_snapshot" :: held 2.111s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:07:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-9621f4e8-3cb1-45cc-9777-8d3572a2d00f" released by "delete_snapshot" :: held 2.152s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:07:15 devstack cinder-volume[94125]: WARNING cinder.quota [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-650508280 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-650508280, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:07:15 devstack cinder-volume[94125]: WARNING cinder.quota [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-650508280 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-650508280, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:07:15 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['d9673208-1d24-4c03-b85c-df3c32b8a85f', '246f183b-4446-40c3-b48a-c91f16aa63b1', 'a39afa1e-0a4d-4942-8796-cca2aa458dc3', '4ead069b-ba8c-4562-86a4-02b09c5d67c1'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:15 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-fdcc2f25-18eb-4482-8a38-63f9ee6a34ce tempest-GroupSnapshotsTest-1709645379 None] group_snapshot b5d8b79b-d5f8-4a3d-b54d-ab239f9082a8: deleted successfully
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Flow 'volume_create_manager' (8c6fe653-da4f-4769-8f62-52f48730eaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b110d3b-eaaa-4100-81e0-31ae1ced4daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b110d3b-eaaa-4100-81e0-31ae1ced4daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1214426955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4161bbdf-c3af-472f-a325-a0637b1eae73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40d9eaa37df481e80f8968cbfe0cd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:07:16Z,use_quota=True,user_id='7c2139ac359f4f5b8fdc4e432bbe819d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee333975-4ee3-4cf5-8041-d0c7ffe2cf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee333975-4ee3-4cf5-8041-d0c7ffe2cf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c1b886-3889-49cf-a8fc-435cb4ffaf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c1b886-3889-49cf-a8fc-435cb4ffaf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4161bbdf-c3af-472f-a325-a0637b1eae73', 'volume_name': 'volume-4161bbdf-c3af-472f-a325-a0637b1eae73', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b62b990-6d5b-4f39-8812-8a6980f8b059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b62b990-6d5b-4f39-8812-8a6980f8b059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197b6e3c-d704-4ea4-b7d7-563402964ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:16 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Volume 4161bbdf-c3af-472f-a325-a0637b1eae73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4161bbdf-c3af-472f-a325-a0637b1eae73', 'volume_size': 1}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1214426955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4161bbdf-c3af-472f-a325-a0637b1eae73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40d9eaa37df481e80f8968cbfe0cd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:07:16Z,use_quota=True,user_id='7c2139ac359f4f5b8fdc4e432bbe819d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Creating volume 4161bbdf-c3af-472f-a325-a0637b1eae73 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:07:16 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4161bbdf-c3af-472f-a325-a0637b1eae73 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:16 devstack sudo[97854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4161bbdf-c3af-472f-a325-a0637b1eae73 1073741824
Aug 26 17:07:16 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-de32c9e0-2fb2-4988-97d1-1e233af9609f req-8aaafa41-01c1-4690-bf59-9e17704ed19a tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "cinder-quobyte-9621f4e8-3cb1-45cc-9777-8d3572a2d00f" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-9621f4e8-3cb1-45cc-9777-8d3572a2d00f" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ad7cdf-06c2-4c07-a405-3b5b84ba5860]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:17 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4161bbdf-c3af-472f-a325-a0637b1eae73 1073741824" returned: 0 in 0.709s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:17 devstack sudo[97860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f
Aug 26 17:07:17 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4161bbdf-c3af-472f-a325-a0637b1eae73 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:17 devstack sudo[97862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4161bbdf-c3af-472f-a325-a0637b1eae73
Aug 26 17:07:17 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:17 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f" returned: 0 in 0.571s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:17 devstack sudo[97869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f
Aug 26 17:07:17 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:17 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4161bbdf-c3af-472f-a325-a0637b1eae73" returned: 0 in 0.338s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-de32c9e0-2fb2-4988-97d1-1e233af9609f req-8aaafa41-01c1-4690-bf59-9e17704ed19a tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-de32c9e0-2fb2-4988-97d1-1e233af9609f req-8aaafa41-01c1-4690-bf59-9e17704ed19a tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197b6e3c-d704-4ea4-b7d7-563402964ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4161bbdf-c3af-472f-a325-a0637b1eae73', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705c4771-5d00-462a-b7b8-d25946440473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:17 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Volume volume-4161bbdf-c3af-472f-a325-a0637b1eae73 (4161bbdf-c3af-472f-a325-a0637b1eae73): created successfully
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705c4771-5d00-462a-b7b8-d25946440473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Flow 'volume_create_manager' (8c6fe653-da4f-4769-8f62-52f48730eaa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:07:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-de32c9e0-2fb2-4988-97d1-1e233af9609f req-8aaafa41-01c1-4690-bf59-9e17704ed19a tempest-ServerActionsTestOtherA-673370039 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '180bcb9f-dfb6-4774-8cd8-fb836f07e5df', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:07:17 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0a28c065-4525-46ee-ae7a-8a55de53fda9 tempest-AttachVolumeTestJSON-1234581717 None] Created volume successfully.
Aug 26 17:07:18 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-de32c9e0-2fb2-4988-97d1-1e233af9609f req-8aaafa41-01c1-4690-bf59-9e17704ed19a tempest-ServerActionsTestOtherA-673370039 None] attachment_update completed successfully.
Aug 26 17:07:18 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9621f4e8-3cb1-45cc-9777-8d3572a2d00f" returned: 0 in 0.524s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Lock "cinder-quobyte-9621f4e8-3cb1-45cc-9777-8d3572a2d00f" released by "delete_volume" :: held 1.161s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:07:18 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['5a906cd2-1868-47e2-9e99-094019bc3a6a'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:18 devstack cinder-volume[94125]: WARNING cinder.quota [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-650508280 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-650508280, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:07:18 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Created reservations ['a7de5962-43b3-4d67-b9a9-86816e3eb16e', '2f1a9906-9139-4f34-8fa6-53f2a5a6f45b', '77337e20-f234-4372-a7f5-e5c4cb9ca50a', '47da0a67-20f5-42f8-97c2-8ef448d62065'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:07:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:07:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:18 devstack sudo[98257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:07:18 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:18 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.306s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:18 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:07:18 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-9285a0e5-6865-4081-a3aa-229dd13da966 tempest-GroupSnapshotsTest-1709645379 None] Delete group completed successfully.
Aug 26 17:07:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-080e7e60-68fa-4701-abf0-5c98e0c039ea req-a9efcfbc-631f-415e-8872-ceeaafcfed95 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-080e7e60-68fa-4701-abf0-5c98e0c039ea req-a9efcfbc-631f-415e-8872-ceeaafcfed95 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-080e7e60-68fa-4701-abf0-5c98e0c039ea req-a9efcfbc-631f-415e-8872-ceeaafcfed95 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-080e7e60-68fa-4701-abf0-5c98e0c039ea req-a9efcfbc-631f-415e-8872-ceeaafcfed95 tempest-AttachVolumeTestJSON-1234581717 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-4161bbdf-c3af-472f-a325-a0637b1eae73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd98ffffd-bff2-42a1-8943-a145262f931b', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:07:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-080e7e60-68fa-4701-abf0-5c98e0c039ea req-a9efcfbc-631f-415e-8872-ceeaafcfed95 tempest-AttachVolumeTestJSON-1234581717 None] attachment_update completed successfully.
Aug 26 17:07:22 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-79644897-82e5-432c-8bd0-8824c6634c29 req-4a6c6eef-9ab5-47cb-8fbe-e35e27cfcaf9 tempest-ServerActionsTestOtherA-673370039 None] Terminate volume connection completed successfully.
Aug 26 17:07:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-79644897-82e5-432c-8bd0-8824c6634c29 req-4a6c6eef-9ab5-47cb-8fbe-e35e27cfcaf9 tempest-ServerActionsTestOtherA-673370039 None] Deleting attachment 180bcb9f-dfb6-4774-8cd8-fb836f07e5df. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:07:23 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Acquiring lock "cinder-1590c216-15ca-45a6-964c-5a2137520ff9-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:07:23 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Lock "cinder-1590c216-15ca-45a6-964c-5a2137520ff9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:07:23 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Acquiring lock "cinder-quobyte-1590c216-15ca-45a6-964c-5a2137520ff9" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:07:23 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Lock "cinder-quobyte-1590c216-15ca-45a6-964c-5a2137520ff9" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:07:23 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e21026-0b1b-4a40-8a8c-ed42e922e547]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:07:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1590c216-15ca-45a6-964c-5a2137520ff9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:23 devstack sudo[98356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1590c216-15ca-45a6-964c-5a2137520ff9
Aug 26 17:07:23 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-79644897-82e5-432c-8bd0-8824c6634c29 req-69ec9b26-5698-4388-88a8-2f2d52b20200 tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-79644897-82e5-432c-8bd0-8824c6634c29 req-69ec9b26-5698-4388-88a8-2f2d52b20200 tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-79644897-82e5-432c-8bd0-8824c6634c29 req-69ec9b26-5698-4388-88a8-2f2d52b20200 tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-79644897-82e5-432c-8bd0-8824c6634c29 req-69ec9b26-5698-4388-88a8-2f2d52b20200 tempest-ServerActionsTestOtherA-673370039 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ec9b7ed-a919-420c-921e-3cdf08088823', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:07:23 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-79644897-82e5-432c-8bd0-8824c6634c29 req-69ec9b26-5698-4388-88a8-2f2d52b20200 tempest-ServerActionsTestOtherA-673370039 None] attachment_update completed successfully.
Aug 26 17:07:23 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1590c216-15ca-45a6-964c-5a2137520ff9" returned: 0 in 0.541s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1590c216-15ca-45a6-964c-5a2137520ff9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:23 devstack sudo[98363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1590c216-15ca-45a6-964c-5a2137520ff9
Aug 26 17:07:23 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:24 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1590c216-15ca-45a6-964c-5a2137520ff9" returned: 0 in 0.436s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Lock "cinder-quobyte-1590c216-15ca-45a6-964c-5a2137520ff9" released by "delete_volume" :: held 1.062s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:07:24 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Created reservations ['0be36b1d-964e-4af5-a392-396296f66911', 'fa5d5d42-865c-449e-b373-13fd47ba6db9', 'b3f0ea83-0f50-4115-bd21-325d0f63daff', '402281f3-31e6-4128-98fc-b51a1a042261'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:07:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:07:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:24 devstack sudo[98372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:07:24 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:24 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.364s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:24 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:07:24 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Deleted volume successfully.
Aug 26 17:07:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8faeef55-8b61-4dde-ae39-c30baf2dec6a tempest-TaggedAttachmentsTest-1904648988 None] Lock "cinder-1590c216-15ca-45a6-964c-5a2137520ff9-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:07:27 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-94441478-3bfb-40ee-9a04-d98abc9748e9 tempest-GroupsTest-1367498410 None] Group tempest-Group1-246537388: creating
Aug 26 17:07:27 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-94441478-3bfb-40ee-9a04-d98abc9748e9 tempest-GroupsTest-1367498410 None] Group tempest-Group1-246537388: created successfully
Aug 26 17:07:27 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-94441478-3bfb-40ee-9a04-d98abc9748e9 tempest-GroupsTest-1367498410 None] Create group completed successfully.
Aug 26 17:07:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b897752b-cadc-4234-b06e-821dec492b89 tempest-GroupsTest-1367498410 None] Group tempest-Group2-2017315465: creating
Aug 26 17:07:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b897752b-cadc-4234-b06e-821dec492b89 tempest-GroupsTest-1367498410 None] Group tempest-Group2-2017315465: created successfully
Aug 26 17:07:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b897752b-cadc-4234-b06e-821dec492b89 tempest-GroupsTest-1367498410 None] Create group completed successfully.
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Flow 'volume_create_manager' (339a0142-096f-4818-b3e6-f34fd58000c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639f74eb-59a9-456c-b772-38a4d74e9e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639f74eb-59a9-456c-b772-38a4d74e9e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2039621387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=414d97f5-3215-44c3-a4ec-b6e28782e6fa,host='devstack@QuobyteHD#QuobyteHD',id=b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6df5704e10f498d99cda3369f9b5e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:07:32Z,use_quota=True,user_id='76746193aea44667ac8f93e483af7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc65c14b-d349-4f04-ae1f-2fb06a0b7cf6),volume_type_id=cc65c14b-d349-4f04-ae1f-2fb06a0b7cf6)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4520fd-5220-4c0c-b7a2-54fc6e41f563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4520fd-5220-4c0c-b7a2-54fc6e41f563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e06b1c7-714e-44b5-8b1c-425b3473cd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e06b1c7-714e-44b5-8b1c-425b3473cd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37', 'volume_name': 'volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d022ce83-0c67-4022-896f-f2903f38594e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d022ce83-0c67-4022-896f-f2903f38594e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8ece77-14d7-4f99-a674-d03294071c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:31 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Volume b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37', 'volume_size': 1}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=414d97f5-3215-44c3-a4ec-b6e28782e6fa,created_at=2026-08-26T15:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2039621387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=414d97f5-3215-44c3-a4ec-b6e28782e6fa,host='devstack@QuobyteHD#QuobyteHD',id=b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6df5704e10f498d99cda3369f9b5e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:07:32Z,use_quota=True,user_id='76746193aea44667ac8f93e483af7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc65c14b-d349-4f04-ae1f-2fb06a0b7cf6),volume_type_id=cc65c14b-d349-4f04-ae1f-2fb06a0b7cf6)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Creating volume b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:07:31 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:07:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:31 devstack sudo[99050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37 1073741824
Aug 26 17:07:31 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:32 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37 1073741824" returned: 0 in 0.887s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:32 devstack sudo[99056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37
Aug 26 17:07:32 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:33 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37" returned: 0 in 0.371s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:07:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8ece77-14d7-4f99-a674-d03294071c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca335b5-615c-4236-ac16-cdb2d4e96419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:33 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Volume volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37 (b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37): created successfully
Aug 26 17:07:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca335b5-615c-4236-ac16-cdb2d4e96419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Flow 'volume_create_manager' (339a0142-096f-4818-b3e6-f34fd58000c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:07:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f60010d3-82ab-4941-bac2-0c903f8601bb tempest-GroupsTest-1367498410 None] Created volume successfully.
Aug 26 17:07:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Acquiring lock "cinder-quobyte-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:07:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Lock "cinder-quobyte-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37" acquired by "delete_volume" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:07:35 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac76cec-ac28-4e07-a4a7-49fb98181b16]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:07:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:35 devstack sudo[99060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37
Aug 26 17:07:35 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:35 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37" returned: 0 in 0.484s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:35 devstack sudo[99067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37
Aug 26 17:07:35 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:35 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37" returned: 0 in 0.250s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Lock "cinder-quobyte-b72aa58e-7a85-4b96-bfe7-2bf7bdd1fb37" released by "delete_volume" :: held 0.808s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:07:35 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Created reservations ['6fa5f31b-a9f6-436f-aeae-077b55c6b675'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:35 devstack cinder-volume[94125]: WARNING cinder.quota [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1722382835 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1722382835, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:07:35 devstack cinder-volume[94125]: WARNING cinder.quota [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1722382835 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1722382835, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:07:35 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Created reservations ['c6b94387-0ab0-4d4b-b0a3-c7acbc8f0563', '553bd7c8-7a4c-4bae-8210-94c59a55beb5', '6987f44d-3bb2-4658-afcc-8eecfe80919a', 'ed090cba-a8ca-40d4-ad8b-fc359ec588bd'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:36 devstack sudo[99071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:07:36 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-01e8a7a3-587f-4b51-81e7-02600b1daf66 tempest-GroupsTest-1367498410 None] Created reservations ['e4370a20-b229-4ea2-bb18-a29a8c3481b5'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:36 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-01e8a7a3-587f-4b51-81e7-02600b1daf66 tempest-GroupsTest-1367498410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-01e8a7a3-587f-4b51-81e7-02600b1daf66 tempest-GroupsTest-1367498410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-01e8a7a3-587f-4b51-81e7-02600b1daf66 tempest-GroupsTest-1367498410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-01e8a7a3-587f-4b51-81e7-02600b1daf66 tempest-GroupsTest-1367498410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-01e8a7a3-587f-4b51-81e7-02600b1daf66 tempest-GroupsTest-1367498410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01e8a7a3-587f-4b51-81e7-02600b1daf66 tempest-GroupsTest-1367498410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.438s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:07:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b929c885-3d6b-437e-a7d6-4140df8052ff tempest-GroupsTest-1367498410 None] Delete group completed successfully.
Aug 26 17:07:36 devstack sudo[99074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:07:36 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:36 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01e8a7a3-587f-4b51-81e7-02600b1daf66 tempest-GroupsTest-1367498410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.337s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:36 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-01e8a7a3-587f-4b51-81e7-02600b1daf66 tempest-GroupsTest-1367498410 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:07:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-01e8a7a3-587f-4b51-81e7-02600b1daf66 tempest-GroupsTest-1367498410 None] Delete group completed successfully.
Aug 26 17:07:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1a753211-2259-4f9c-b7eb-e0d5c8860796 tempest-GroupsTest-1367498410 None] Group tempest-GroupsTest-Group-450596255: creating
Aug 26 17:07:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1a753211-2259-4f9c-b7eb-e0d5c8860796 tempest-GroupsTest-1367498410 None] Group tempest-GroupsTest-Group-450596255: created successfully
Aug 26 17:07:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1a753211-2259-4f9c-b7eb-e0d5c8860796 tempest-GroupsTest-1367498410 None] Create group completed successfully.
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Flow 'volume_create_manager' (99684a9b-57f9-48bf-a96c-135193d4fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a705f3-8631-4a27-b8a6-04c151ccf254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a705f3-8631-4a27-b8a6-04c151ccf254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-419556615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a9b27f79-bf1c-4b5a-a314-b5b818054f7c,host='devstack@QuobyteHD#QuobyteHD',id=66ca190d-18f6-44f4-b6de-5283ad998a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6df5704e10f498d99cda3369f9b5e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:07:40Z,use_quota=True,user_id='76746193aea44667ac8f93e483af7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a647bc67-cf48-4540-9ebd-58d4b147cef9),volume_type_id=a647bc67-cf48-4540-9ebd-58d4b147cef9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79a8fee-e52e-49b4-809f-4401a1030735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79a8fee-e52e-49b4-809f-4401a1030735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fc11b5-16ec-43ab-8e36-20b10c21c726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fc11b5-16ec-43ab-8e36-20b10c21c726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ca190d-18f6-44f4-b6de-5283ad998a49', 'volume_name': 'volume-66ca190d-18f6-44f4-b6de-5283ad998a49', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7564db2d-cd26-408e-9d14-5e3d46be5d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7564db2d-cd26-408e-9d14-5e3d46be5d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4084d271-07ad-47aa-8be7-41f7b0675d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:40 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Volume 66ca190d-18f6-44f4-b6de-5283ad998a49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ca190d-18f6-44f4-b6de-5283ad998a49', 'volume_size': 1}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a9b27f79-bf1c-4b5a-a314-b5b818054f7c,created_at=2026-08-26T15:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-419556615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a9b27f79-bf1c-4b5a-a314-b5b818054f7c,host='devstack@QuobyteHD#QuobyteHD',id=66ca190d-18f6-44f4-b6de-5283ad998a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6df5704e10f498d99cda3369f9b5e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:07:40Z,use_quota=True,user_id='76746193aea44667ac8f93e483af7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a647bc67-cf48-4540-9ebd-58d4b147cef9),volume_type_id=a647bc67-cf48-4540-9ebd-58d4b147cef9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Creating volume 66ca190d-18f6-44f4-b6de-5283ad998a49 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:07:40 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:07:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-66ca190d-18f6-44f4-b6de-5283ad998a49 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:40 devstack sudo[99081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-66ca190d-18f6-44f4-b6de-5283ad998a49 1073741824
Aug 26 17:07:40 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:41 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-66ca190d-18f6-44f4-b6de-5283ad998a49 1073741824" returned: 0 in 0.826s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-66ca190d-18f6-44f4-b6de-5283ad998a49 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:41 devstack sudo[99096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-66ca190d-18f6-44f4-b6de-5283ad998a49
Aug 26 17:07:41 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:41 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-66ca190d-18f6-44f4-b6de-5283ad998a49" returned: 0 in 0.353s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:07:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4084d271-07ad-47aa-8be7-41f7b0675d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ca190d-18f6-44f4-b6de-5283ad998a49', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c45912-a2cf-487b-b3a0-8666f90cb34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:41 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Volume volume-66ca190d-18f6-44f4-b6de-5283ad998a49 (66ca190d-18f6-44f4-b6de-5283ad998a49): created successfully
Aug 26 17:07:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c45912-a2cf-487b-b3a0-8666f90cb34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Flow 'volume_create_manager' (99684a9b-57f9-48bf-a96c-135193d4fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:07:41 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-85341639-43c1-4bb0-bb1b-83a9cc173182 tempest-GroupsTest-1367498410 None] Created volume successfully.
Aug 26 17:07:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:07:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:07:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:07:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:42 devstack sudo[99111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:07:42 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:42 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.402s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:07:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:07:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 8 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:07:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Flow 'volume_create_manager' (42d30af6-c4f7-4297-bb41-889051a1582d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b79269-9615-47f0-b173-76d0864b4ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b79269-9615-47f0-b173-76d0864b4ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-856670676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a9b27f79-bf1c-4b5a-a314-b5b818054f7c,host='devstack@QuobyteHD#QuobyteHD',id=fa6a4c5e-0232-4342-aa9e-a2b780eb2b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6df5704e10f498d99cda3369f9b5e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:07:44Z,use_quota=True,user_id='76746193aea44667ac8f93e483af7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a647bc67-cf48-4540-9ebd-58d4b147cef9),volume_type_id=a647bc67-cf48-4540-9ebd-58d4b147cef9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afe2dd9-2163-471f-9e40-3e334493eb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afe2dd9-2163-471f-9e40-3e334493eb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ec59b5-33d8-48b4-b0f4-71d89f727241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ec59b5-33d8-48b4-b0f4-71d89f727241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6a4c5e-0232-4342-aa9e-a2b780eb2b60', 'volume_name': 'volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e53c01b-3ef8-4791-9180-daac084c3c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e53c01b-3ef8-4791-9180-daac084c3c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd458df-4b4f-4a5e-8284-fa6c8d335b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:43 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Volume fa6a4c5e-0232-4342-aa9e-a2b780eb2b60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60', 'volume_size': 1}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a9b27f79-bf1c-4b5a-a314-b5b818054f7c,created_at=2026-08-26T15:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-856670676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a9b27f79-bf1c-4b5a-a314-b5b818054f7c,host='devstack@QuobyteHD#QuobyteHD',id=fa6a4c5e-0232-4342-aa9e-a2b780eb2b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6df5704e10f498d99cda3369f9b5e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:07:44Z,use_quota=True,user_id='76746193aea44667ac8f93e483af7965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a647bc67-cf48-4540-9ebd-58d4b147cef9),volume_type_id=a647bc67-cf48-4540-9ebd-58d4b147cef9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Creating volume fa6a4c5e-0232-4342-aa9e-a2b780eb2b60 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:07:43 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:07:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:43 devstack sudo[99114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60 1073741824
Aug 26 17:07:43 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:44 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60 1073741824" returned: 0 in 0.505s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:44 devstack sudo[99124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60
Aug 26 17:07:44 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:44 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60" returned: 0 in 0.348s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:07:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd458df-4b4f-4a5e-8284-fa6c8d335b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7025fe41-2139-4237-9e64-d2f52752fbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:07:44 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Volume volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60 (fa6a4c5e-0232-4342-aa9e-a2b780eb2b60): created successfully
Aug 26 17:07:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7025fe41-2139-4237-9e64-d2f52752fbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:07:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Flow 'volume_create_manager' (42d30af6-c4f7-4297-bb41-889051a1582d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:07:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e6cdd10e-8ffc-4ce2-9f20-531569c9617a tempest-GroupsTest-1367498410 None] Created volume successfully.
Aug 26 17:07:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-27bc5640-b498-40ea-bb12-c8a40ef99f80 tempest-GroupsTest-1367498410 None] Update group completed successfully.
Aug 26 17:07:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-af749799-fd0f-46d1-a9cb-73411c623305 tempest-GroupsTest-1367498410 None] Update group completed successfully.
Aug 26 17:07:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Acquiring lock "cinder-quobyte-66ca190d-18f6-44f4-b6de-5283ad998a49" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:07:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Lock "cinder-quobyte-66ca190d-18f6-44f4-b6de-5283ad998a49" acquired by "delete_volume" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:07:48 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c21b315-a5ce-4d4a-a9d5-e95ab55c1463]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:07:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-66ca190d-18f6-44f4-b6de-5283ad998a49 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:48 devstack sudo[99196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-66ca190d-18f6-44f4-b6de-5283ad998a49
Aug 26 17:07:48 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:48 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-66ca190d-18f6-44f4-b6de-5283ad998a49" returned: 0 in 0.419s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-66ca190d-18f6-44f4-b6de-5283ad998a49 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:48 devstack sudo[99201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-66ca190d-18f6-44f4-b6de-5283ad998a49
Aug 26 17:07:48 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:48 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-66ca190d-18f6-44f4-b6de-5283ad998a49" returned: 0 in 0.301s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Lock "cinder-quobyte-66ca190d-18f6-44f4-b6de-5283ad998a49" released by "delete_volume" :: held 0.771s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:07:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Acquiring lock "cinder-quobyte-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:07:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Lock "cinder-quobyte-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:07:49 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3f9a0e-edd2-48bc-9e10-5b82cf58a338]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:07:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:49 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60
Aug 26 17:07:49 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:49 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60" returned: 0 in 0.380s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:49 devstack sudo[99209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60
Aug 26 17:07:49 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:49 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60" returned: 0 in 0.313s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Lock "cinder-quobyte-fa6a4c5e-0232-4342-aa9e-a2b780eb2b60" released by "delete_volume" :: held 0.737s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:07:49 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Created reservations ['b97c76b6-091a-4636-b6c5-17e78c4f33f2'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:49 devstack cinder-volume[94125]: WARNING cinder.quota [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-4713343 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-4713343, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:07:49 devstack cinder-volume[94125]: WARNING cinder.quota [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-4713343 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-4713343, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:07:49 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Created reservations ['1cd0685c-e004-4f09-87ee-fa004b30401b', 'c666f83a-4a3c-4b8f-b98f-a1d4aeda5b24', '7750c8f4-f383-44c5-8b4a-ebcd1f2a3090', '0b4d4885-a12d-44a7-8708-22e8d9b59f8b'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:49 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Created reservations ['33f65875-2dff-47e3-a073-6b497ec2ab42', 'c29f9a95-415b-4198-8a8d-def40c13737c', '56755bb7-79ad-4ae1-a66c-0d01d3911002', '6f257f45-bf2d-4fc8-a534-203004b7983d'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:07:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:07:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:07:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:07:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:07:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:07:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:07:50 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:07:50 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:07:50 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Aug 26 17:07:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.299s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:07:50 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:07:50 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-80bed70e-25d4-4fc9-b71c-8a082df4a245 tempest-GroupsTest-1367498410 None] Delete group completed successfully.
Aug 26 17:07:55 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=141,cinder:INSERT=28,cinder:UPDATE=127,cinder:DELETE=3 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:07:55 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=112,cinder:SELECT=121,cinder:INSERT=24,cinder:DELETE=3 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:07:55 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-435e1100-20b8-4533-a690-2d917df4264f req-02be99fa-8312-4f73-9157-5633f72be3d9 tempest-ServerActionsTestOtherA-673370039 None] Terminate volume connection completed successfully.
Aug 26 17:07:55 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-435e1100-20b8-4533-a690-2d917df4264f req-02be99fa-8312-4f73-9157-5633f72be3d9 tempest-ServerActionsTestOtherA-673370039 None] Deleting attachment 8ec9b7ed-a919-420c-921e-3cdf08088823. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:08:02 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:08:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Flow 'volume_create_manager' (e2975505-16b4-49c3-947a-3c6f9c04514b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:08:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465f7ab8-b8d4-4a0e-a9a2-05e206bc21bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465f7ab8-b8d4-4a0e-a9a2-05e206bc21bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-775198468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a21e37-5e75-4da8-8ae7-d3636a615e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f907ea43038c45a79aa0a852f1e85df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:08:02Z,use_quota=True,user_id='576b0fd7fd2c48dca60883871faf1154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c808be-2969-4d76-9764-d82f58d833eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c808be-2969-4d76-9764-d82f58d833eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d717de-26d7-4360-8d4b-43ba1cb50a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:02 devstack cinder-volume[94125]: DEBUG cinder.image.glance [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Creating Keystone auth plugin from conf {{(pid=94125) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d717de-26d7-4360-8d4b-43ba1cb50a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd7a21e37-5e75-4da8-8ae7-d3636a615e15', 'volume_name': 'volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd2320c0>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed422a2-3d09-4c93-ad07-9178c6a383b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed422a2-3d09-4c93-ad07-9178c6a383b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc7dcfb-5a6a-4b82-ab0d-6b5d62300e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:03 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Volume d7a21e37-5e75-4da8-8ae7-d3636a615e15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd2320c0>}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Trying to clone d7a21e37-5e75-4da8-8ae7-d3636a615e15 from image b24297bc-5b4d-44da-a168-9014960429c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]). {{(pid=94125) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Flow 'volume_create_manager' (4141af37-6e30-48fc-b893-d82c29b780f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367d0ca5-426c-46f8-ad13-adbfa7113d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367d0ca5-426c-46f8-ad13-adbfa7113d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1843895901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407313a1-2362-4d32-9151-0c9d97eb8034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b51b83da5a4e8a8e68f84912fb26ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:08:03Z,use_quota=True,user_id='8e6058b225234c659a9009bf6599d494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac05d96-a0ea-4447-bab0-69e788782d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac05d96-a0ea-4447-bab0-69e788782d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ef3afa-083c-4ae1-94cd-eb8a3a873d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ef3afa-083c-4ae1-94cd-eb8a3a873d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407313a1-2362-4d32-9151-0c9d97eb8034', 'volume_name': 'volume-407313a1-2362-4d32-9151-0c9d97eb8034', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ecf8d6-f155-4779-9316-928c90fefe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ecf8d6-f155-4779-9316-928c90fefe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b18ba3-8172-41bf-9f12-8d0f825daa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:03 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Volume 407313a1-2362-4d32-9151-0c9d97eb8034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407313a1-2362-4d32-9151-0c9d97eb8034', 'volume_size': 1}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1843895901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407313a1-2362-4d32-9151-0c9d97eb8034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b51b83da5a4e8a8e68f84912fb26ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:08:03Z,use_quota=True,user_id='8e6058b225234c659a9009bf6599d494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Creating volume 407313a1-2362-4d32-9151-0c9d97eb8034 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:08:03 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-407313a1-2362-4d32-9151-0c9d97eb8034 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:03 devstack sudo[99304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-407313a1-2362-4d32-9151-0c9d97eb8034 1073741824
Aug 26 17:08:03 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 17:08:03 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Image download 20.69 MB at 20.69 MB/s
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4306eef-5fbe-41df-a44f-5f94152b052d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:08:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:03 devstack sudo[99337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD
Aug 26 17:08:03 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:04 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-407313a1-2362-4d32-9151-0c9d97eb8034 1073741824" returned: 0 in 0.806s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-407313a1-2362-4d32-9151-0c9d97eb8034 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:04 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Temporary image b24297bc-5b4d-44da-a168-9014960429c1 is fetched for user 576b0fd7fd2c48dca60883871faf1154. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 17:08:04 devstack sudo[99366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-407313a1-2362-4d32-9151-0c9d97eb8034
Aug 26 17:08:04 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4289799f-1f38-4a81-a633-693aefa30fbe]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:04 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-407313a1-2362-4d32-9151-0c9d97eb8034" returned: 0 in 0.457s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:04 devstack sudo[99377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD
Aug 26 17:08:04 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b18ba3-8172-41bf-9f12-8d0f825daa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407313a1-2362-4d32-9151-0c9d97eb8034', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fc38ef-2d88-4022-b03c-64d6b64de734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:04 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Volume volume-407313a1-2362-4d32-9151-0c9d97eb8034 (407313a1-2362-4d32-9151-0c9d97eb8034): created successfully
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fc38ef-2d88-4022-b03c-64d6b64de734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Flow 'volume_create_manager' (4141af37-6e30-48fc-b893-d82c29b780f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:08:04 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-85171148-9c23-4490-8c09-9c8a010a609a tempest-VolumesServicesTestJSON-1396158978 None] Created volume successfully.
Aug 26 17:08:05 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-775198468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a21e37-5e75-4da8-8ae7-d3636a615e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f907ea43038c45a79aa0a852f1e85df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:08:02Z,use_quota=True,user_id='576b0fd7fd2c48dca60883871faf1154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Creating volume d7a21e37-5e75-4da8-8ae7-d3636a615e15 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:08:05 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:05 devstack sudo[99401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15 1073741824
Aug 26 17:08:05 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Acquiring lock "cinder-407313a1-2362-4d32-9151-0c9d97eb8034-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:08:05 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Lock "cinder-407313a1-2362-4d32-9151-0c9d97eb8034-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15 1073741824" returned: 0 in 0.559s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Acquiring lock "cinder-quobyte-407313a1-2362-4d32-9151-0c9d97eb8034" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:08:05 devstack sudo[99414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15
Aug 26 17:08:05 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Lock "cinder-quobyte-407313a1-2362-4d32-9151-0c9d97eb8034" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc538cc5-edd7-4e15-b323-6d72a06bb24a]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-407313a1-2362-4d32-9151-0c9d97eb8034 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:05 devstack sudo[99416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-407313a1-2362-4d32-9151-0c9d97eb8034
Aug 26 17:08:05 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:05 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15" returned: 0 in 0.308s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:08:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Attempting download of b24297bc-5b4d-44da-a168-9014960429c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}])) to volume d7a21e37-5e75-4da8-8ae7-d3636a615e15. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[87adcc71-7ea2-4b5e-9769-18301037e2d3]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_ezivnw2s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:06 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-407313a1-2362-4d32-9151-0c9d97eb8034" returned: 0 in 0.456s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-407313a1-2362-4d32-9151-0c9d97eb8034 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:06 devstack sudo[99425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-407313a1-2362-4d32-9151-0c9d97eb8034
Aug 26 17:08:06 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:06 devstack sudo[99424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_ezivnw2s
Aug 26 17:08:06 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:06 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:06 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_ezivnw2s" returned: 0 in 0.432s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_ezivnw2s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-407313a1-2362-4d32-9151-0c9d97eb8034" returned: 0 in 0.356s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Lock "cinder-quobyte-407313a1-2362-4d32-9151-0c9d97eb8034" released by "delete_volume" :: held 0.868s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Created reservations ['a5ffab21-0438-4cf5-a97d-40ff6d0f4349', 'f34174c9-4266-48d8-b339-f06359187aad', 'e16c33d3-6434-44a2-811b-4533701cf38f', 'b4e487eb-3d90-4e06-94be-1055fb8ae2c4'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:08:06 devstack sudo[99431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_ezivnw2s
Aug 26 17:08:06 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:06 devstack sudo[99433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:08:06 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:06 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_ezivnw2s" returned: 1 in 0.432s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_ezivnw2s' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:08:06 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3467502c-2385-4b29-82e8-ab3da9d566b6]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:08:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:07 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.331s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:07 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:08:07 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Deleted volume successfully.
Aug 26 17:08:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0eaac474-820c-4841-80ed-1fb075c820c1 tempest-VolumesServicesTestJSON-1396158978 None] Lock "cinder-407313a1-2362-4d32-9151-0c9d97eb8034-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:08:07 devstack sudo[99437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD
Aug 26 17:08:07 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:07 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:07 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] b24297bc-5b4d-44da-a168-9014960429c1 was qcow2, converting to qcow2 {{(pid=94125) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 17:08:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:07 devstack sudo[99445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15
Aug 26 17:08:07 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:09 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-43e25903-c5ec-4659-9a38-805b1bf400e9 req-48c3321a-d662-4aaa-86da-0c6421525008 tempest-AttachVolumeTestJSON-1234581717 None] Terminate volume connection completed successfully.
Aug 26 17:08:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-43e25903-c5ec-4659-9a38-805b1bf400e9 req-48c3321a-d662-4aaa-86da-0c6421525008 tempest-AttachVolumeTestJSON-1234581717 None] Deleting attachment d98ffffd-bff2-42a1-8943-a145262f931b. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:08:10 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15" returned: 0 in 2.901s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:10 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__jzd9rpgdevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:08:10 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Converted 112.00 MB image at 38.60 MB/s
Aug 26 17:08:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:10 devstack sudo[99500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15 1G
Aug 26 17:08:10 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:11 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15 1G" returned: 0 in 0.590s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:11 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Downloaded image b24297bc-5b4d-44da-a168-9014960429c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}])) to volume d7a21e37-5e75-4da8-8ae7-d3636a615e15 successfully. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 17:08:11 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Temporary image b24297bc-5b4d-44da-a168-9014960429c1 for user 576b0fd7fd2c48dca60883871faf1154 is deleted. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 17:08:11 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Marking volume d7a21e37-5e75-4da8-8ae7-d3636a615e15 as bootable. {{(pid=94125) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 17:08:11 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Copying metadata from image b24297bc-5b4d-44da-a168-9014960429c1 to d7a21e37-5e75-4da8-8ae7-d3636a615e15. {{(pid=94125) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 17:08:11 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Creating volume glance metadata for volume d7a21e37-5e75-4da8-8ae7-d3636a615e15 backed by image b24297bc-5b4d-44da-a168-9014960429c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94125) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 17:08:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc7dcfb-5a6a-4b82-ab0d-6b5d62300e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd2320c0>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a6a1cb-891a-45fa-95bb-e6e2257484f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:11 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Volume volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15 (d7a21e37-5e75-4da8-8ae7-d3636a615e15): created successfully
Aug 26 17:08:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a6a1cb-891a-45fa-95bb-e6e2257484f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Flow 'volume_create_manager' (e2975505-16b4-49c3-947a-3c6f9c04514b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:08:11 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-738a63db-aa21-4db5-95c3-d47c969139fe tempest-ServerActionsTestOtherA-673370039 None] Created volume successfully.
Aug 26 17:08:15 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:08:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Flow 'volume_create_manager' (84590e4c-712a-4b3e-9282-fd6f9714eac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:08:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d5d65c-6f38-4c98-8011-d7e7b06f424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d5d65c-6f38-4c98-8011-d7e7b06f424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-338692654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d8e1d7-591f-4602-9e40-085a2aa935f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d282f01b80864487a2885c99a8b307c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:08:16Z,use_quota=True,user_id='0b66c96c0200490cad811fe648afcd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca15e007-3f7e-434a-82b4-13cea304d6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca15e007-3f7e-434a-82b4-13cea304d6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fca74e-7456-4a60-9cac-976f155a8678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7fca74e-7456-4a60-9cac-976f155a8678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d8e1d7-591f-4602-9e40-085a2aa935f8', 'volume_name': 'volume-76d8e1d7-591f-4602-9e40-085a2aa935f8', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1792c3b8-a11a-4c8c-bf99-fdff238a6c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1792c3b8-a11a-4c8c-bf99-fdff238a6c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb768d6-3bea-4893-a3c3-f5abb09042c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:16 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Volume 76d8e1d7-591f-4602-9e40-085a2aa935f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d8e1d7-591f-4602-9e40-085a2aa935f8', 'volume_size': 1}
Aug 26 17:08:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-338692654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d8e1d7-591f-4602-9e40-085a2aa935f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d282f01b80864487a2885c99a8b307c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:08:16Z,use_quota=True,user_id='0b66c96c0200490cad811fe648afcd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:08:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Creating volume 76d8e1d7-591f-4602-9e40-085a2aa935f8 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:08:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:08:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:08:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:08:16 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:08:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:16 devstack sudo[99596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8 1073741824
Aug 26 17:08:16 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:17 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8 1073741824" returned: 0 in 1.173s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:17 devstack sudo[99647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8
Aug 26 17:08:17 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-9bb132fc-976e-4d96-9321-581b53561e97 req-0d520d3b-af36-4a46-af29-1c52c059d51a tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:17 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8" returned: 0 in 0.538s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-9bb132fc-976e-4d96-9321-581b53561e97 req-0d520d3b-af36-4a46-af29-1c52c059d51a tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.050s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-9bb132fc-976e-4d96-9321-581b53561e97 req-0d520d3b-af36-4a46-af29-1c52c059d51a tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb768d6-3bea-4893-a3c3-f5abb09042c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d8e1d7-591f-4602-9e40-085a2aa935f8', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6700e6a-a859-48e2-9cf0-ec570c42d223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:17 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Volume volume-76d8e1d7-591f-4602-9e40-085a2aa935f8 (76d8e1d7-591f-4602-9e40-085a2aa935f8): created successfully
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6700e6a-a859-48e2-9cf0-ec570c42d223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Flow 'volume_create_manager' (84590e4c-712a-4b3e-9282-fd6f9714eac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:08:17 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8f1c7321-ebcc-4979-8a66-43f64c2e11b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Created volume successfully.
Aug 26 17:08:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-9bb132fc-976e-4d96-9321-581b53561e97 req-0d520d3b-af36-4a46-af29-1c52c059d51a tempest-ServerActionsTestOtherA-673370039 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcb3739a-0423-46b3-a5e1-01fafd3507c0', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:08:18 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-9bb132fc-976e-4d96-9321-581b53561e97 req-0d520d3b-af36-4a46-af29-1c52c059d51a tempest-ServerActionsTestOtherA-673370039 None] attachment_update completed successfully.
Aug 26 17:08:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Creating offline snapshot 2c8cb915-ee1f-4632-8670-1ca248fd8e95 of volume 76d8e1d7-591f-4602-9e40-085a2aa935f8 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:08:19 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de01116-c127-4de1-ac82-d69af8157210]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:08:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:19 devstack sudo[99686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8
Aug 26 17:08:19 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:19 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8" returned: 0 in 0.464s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:19 devstack sudo[99692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95 1G
Aug 26 17:08:19 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:20 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95 1G" returned: 0 in 0.490s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d8e1d7-591f-4602-9e40-085a2aa935f8 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:20 devstack sudo[99699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d8e1d7-591f-4602-9e40-085a2aa935f8 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95
Aug 26 17:08:20 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:20 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d8e1d7-591f-4602-9e40-085a2aa935f8 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95" returned: 0 in 0.406s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:20 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95 is being set with open permissions: ugo+rw
Aug 26 17:08:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:20 devstack sudo[99772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95
Aug 26 17:08:20 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:21 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95" returned: 0 in 0.435s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:21 devstack sudo[99794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.info
Aug 26 17:08:21 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:21 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.info" returned: 0 in 0.414s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:21 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.info is being set with open permissions: ugo+rw
Aug 26 17:08:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:21 devstack sudo[100118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.info
Aug 26 17:08:21 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:22 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.info" returned: 0 in 0.375s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:22 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-54ef2b1b-b125-4fc3-b061-a62c5428ea22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Create snapshot completed successfully
Aug 26 17:08:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Acquiring lock "cinder-2c8cb915-ee1f-4632-8670-1ca248fd8e95-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:08:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "cinder-2c8cb915-ee1f-4632-8670-1ca248fd8e95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:08:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Acquiring lock "cinder-quobyte-76d8e1d7-591f-4602-9e40-085a2aa935f8" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:08:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "cinder-quobyte-76d8e1d7-591f-4602-9e40-085a2aa935f8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:08:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Acquiring lock "cinder-quobyte-2c8cb915-ee1f-4632-8670-1ca248fd8e95" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:08:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "cinder-quobyte-2c8cb915-ee1f-4632-8670-1ca248fd8e95" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:08:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Deleting offline snapshot 2c8cb915-ee1f-4632-8670-1ca248fd8e95 of volume 76d8e1d7-591f-4602-9e40-085a2aa935f8 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:08:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] snapshot_file for this snap is: volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:08:23 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff9df80-daa1-45da-9120-e185e1acfbd6]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:08:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:23 devstack sudo[100151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95
Aug 26 17:08:23 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:23 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95" returned: 0 in 0.415s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76d8e1d7-591f-4602-9e40-085a2aa935f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:08:23 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a23506-cd60-40dd-8545-871323d5fc5a]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:08:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:23 devstack sudo[100156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8
Aug 26 17:08:23 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:23 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8" returned: 0 in 0.470s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:24 devstack sudo[100164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95
Aug 26 17:08:24 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:24 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95" returned: 0 in 0.626s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:24 devstack sudo[100171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95
Aug 26 17:08:24 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:25 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8.2c8cb915-ee1f-4632-8670-1ca248fd8e95" returned: 0 in 0.631s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "cinder-quobyte-2c8cb915-ee1f-4632-8670-1ca248fd8e95" released by "_delete_snapshot" :: held 2.328s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:08:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "cinder-quobyte-76d8e1d7-591f-4602-9e40-085a2aa935f8" released by "delete_snapshot" :: held 2.383s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:08:25 devstack cinder-volume[94125]: WARNING cinder.quota [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:08:25 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Created reservations ['709ff759-0f25-4452-b90a-ab5b2ae30c7d', 'f1b099d6-c266-4f8d-aa10-6f72a3b93cbb', '0f30f0f4-35f6-4454-a30b-08319082dc3d', '228ee4af-1b91-414c-be89-4e7241162f82'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:08:25 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Delete snapshot completed successfully.
Aug 26 17:08:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9db91241-d988-427e-830f-2f2cbf7edaa3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "cinder-2c8cb915-ee1f-4632-8670-1ca248fd8e95-delete_snapshot" released by "delete_snapshot" :: held 2.708s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:08:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Acquiring lock "cinder-76d8e1d7-591f-4602-9e40-085a2aa935f8-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:08:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "cinder-76d8e1d7-591f-4602-9e40-085a2aa935f8-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:08:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Acquiring lock "cinder-quobyte-76d8e1d7-591f-4602-9e40-085a2aa935f8" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:08:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "cinder-quobyte-76d8e1d7-591f-4602-9e40-085a2aa935f8" acquired by "delete_volume" :: waited 0.036s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:08:26 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05f2dd3-c96b-41d4-81e3-8e30f3cebe45]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:08:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:26 devstack sudo[100179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8
Aug 26 17:08:26 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:27 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8" returned: 0 in 0.635s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:27 devstack sudo[100188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8
Aug 26 17:08:27 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:27 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76d8e1d7-591f-4602-9e40-085a2aa935f8" returned: 0 in 0.419s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:27 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "cinder-quobyte-76d8e1d7-591f-4602-9e40-085a2aa935f8" released by "delete_volume" :: held 1.209s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:08:27 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Created reservations ['be965b06-d879-4b3a-b620-8aab2a4bf819', 'fa7a39f0-b9f6-4978-a03e-f4b1e7bd84aa', '3658cc7b-8b54-415e-bc86-0602275de13b', 'd9671147-0e0c-4977-9c27-9b4fca86cccb'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:08:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:08:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:08:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:28 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:08:28 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:28 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.489s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:28 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:08:28 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Deleted volume successfully.
Aug 26 17:08:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e959807-034e-4e86-9b7a-b1317cc77c72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1379753450 None] Lock "cinder-76d8e1d7-591f-4602-9e40-085a2aa935f8-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Flow 'volume_create_manager' (ec438230-2a0a-435b-9e92-75f3f0dd81ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a523b80f-0843-4a46-9b5a-d792e2c55d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a523b80f-0843-4a46-9b5a-d792e2c55d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1207818523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b468de-7752-49fc-89dd-ed7e48390a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd8b84353014792953d4383f32adb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:08:31Z,use_quota=True,user_id='ba47ba9ad77340479e124113a03068fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9bd4f3-3ccd-4ce9-bd20-f99f6a989501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9bd4f3-3ccd-4ce9-bd20-f99f6a989501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d2a6d5-d650-4f9f-9eb7-556e44768cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d2a6d5-d650-4f9f-9eb7-556e44768cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b468de-7752-49fc-89dd-ed7e48390a7b', 'volume_name': 'volume-b6b468de-7752-49fc-89dd-ed7e48390a7b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a723eaa-5518-4a68-8805-0f2c76986ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a723eaa-5518-4a68-8805-0f2c76986ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ab4214-341e-4896-be9f-ff753a94af2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:31 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Volume b6b468de-7752-49fc-89dd-ed7e48390a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b468de-7752-49fc-89dd-ed7e48390a7b', 'volume_size': 1}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1207818523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b468de-7752-49fc-89dd-ed7e48390a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd8b84353014792953d4383f32adb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:08:31Z,use_quota=True,user_id='ba47ba9ad77340479e124113a03068fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Creating volume b6b468de-7752-49fc-89dd-ed7e48390a7b {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:08:31 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:08:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b6b468de-7752-49fc-89dd-ed7e48390a7b 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:31 devstack sudo[100201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b6b468de-7752-49fc-89dd-ed7e48390a7b 1073741824
Aug 26 17:08:31 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:32 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b6b468de-7752-49fc-89dd-ed7e48390a7b 1073741824" returned: 0 in 1.031s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b6b468de-7752-49fc-89dd-ed7e48390a7b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:32 devstack sudo[100212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b6b468de-7752-49fc-89dd-ed7e48390a7b
Aug 26 17:08:32 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:32 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b6b468de-7752-49fc-89dd-ed7e48390a7b" returned: 0 in 0.482s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:08:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ab4214-341e-4896-be9f-ff753a94af2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b468de-7752-49fc-89dd-ed7e48390a7b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea64422b-55a2-4349-8c9c-3a56579dee1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:32 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Volume volume-b6b468de-7752-49fc-89dd-ed7e48390a7b (b6b468de-7752-49fc-89dd-ed7e48390a7b): created successfully
Aug 26 17:08:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea64422b-55a2-4349-8c9c-3a56579dee1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Flow 'volume_create_manager' (ec438230-2a0a-435b-9e92-75f3f0dd81ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:08:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ea8f1d55-950e-49ff-9111-d4397f608553 tempest-AttachVolumeShelveTestJSON-310166197 None] Created volume successfully.
Aug 26 17:08:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-a35a449f-a9e3-47e1-9f79-892cd05dc205 req-cdb7cb27-0e0f-496d-a201-a2c3529db8b3 tempest-ServerActionsTestOtherA-673370039 None] Terminate volume connection completed successfully.
Aug 26 17:08:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-a35a449f-a9e3-47e1-9f79-892cd05dc205 req-cdb7cb27-0e0f-496d-a201-a2c3529db8b3 tempest-ServerActionsTestOtherA-673370039 None] Deleting attachment fcb3739a-0423-46b3-a5e1-01fafd3507c0. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:08:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-a35a449f-a9e3-47e1-9f79-892cd05dc205 req-18fdb614-dc6c-4b2f-910d-b0766ac885b6 tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-a35a449f-a9e3-47e1-9f79-892cd05dc205 req-18fdb614-dc6c-4b2f-910d-b0766ac885b6 tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-a35a449f-a9e3-47e1-9f79-892cd05dc205 req-18fdb614-dc6c-4b2f-910d-b0766ac885b6 tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-a35a449f-a9e3-47e1-9f79-892cd05dc205 req-18fdb614-dc6c-4b2f-910d-b0766ac885b6 tempest-ServerActionsTestOtherA-673370039 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab93d572-7078-4a6b-af59-81834b282d33', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:08:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-a35a449f-a9e3-47e1-9f79-892cd05dc205 req-18fdb614-dc6c-4b2f-910d-b0766ac885b6 tempest-ServerActionsTestOtherA-673370039 None] attachment_update completed successfully.
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Flow 'volume_create_manager' (d9f23e58-d0cc-4573-986d-5088dc447608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ced062-5999-4796-b251-7c2ff0c5d8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ced062-5999-4796-b251-7c2ff0c5d8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-157031274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51b5a80-feae-4b73-98fa-4176572e8b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b228ede3d077427db19b70e4183c47bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:08:39Z,use_quota=True,user_id='607d5fabbb9747f090a665e1db3a7146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b4f1756-b26d-40f4-af72-ac2b10f4ef5c),volume_type_id=1b4f1756-b26d-40f4-af72-ac2b10f4ef5c)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe01e5d7-240d-4dd1-8a2b-e0e2c676d09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe01e5d7-240d-4dd1-8a2b-e0e2c676d09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c474190c-044b-46f4-be31-c69e76757a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c474190c-044b-46f4-be31-c69e76757a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f51b5a80-feae-4b73-98fa-4176572e8b1f', 'volume_name': 'volume-f51b5a80-feae-4b73-98fa-4176572e8b1f', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad65969-bc88-40cb-8e9c-9f729d313fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad65969-bc88-40cb-8e9c-9f729d313fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e6a78b-09e8-44f9-b1ab-c34e85ce0b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:39 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Volume f51b5a80-feae-4b73-98fa-4176572e8b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f51b5a80-feae-4b73-98fa-4176572e8b1f', 'volume_size': 1}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-157031274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51b5a80-feae-4b73-98fa-4176572e8b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b228ede3d077427db19b70e4183c47bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:08:39Z,use_quota=True,user_id='607d5fabbb9747f090a665e1db3a7146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b4f1756-b26d-40f4-af72-ac2b10f4ef5c),volume_type_id=1b4f1756-b26d-40f4-af72-ac2b10f4ef5c)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Creating volume f51b5a80-feae-4b73-98fa-4176572e8b1f {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:08:39 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:08:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f51b5a80-feae-4b73-98fa-4176572e8b1f 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:39 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f51b5a80-feae-4b73-98fa-4176572e8b1f 1073741824
Aug 26 17:08:39 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:40 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f51b5a80-feae-4b73-98fa-4176572e8b1f 1073741824" returned: 0 in 0.813s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f51b5a80-feae-4b73-98fa-4176572e8b1f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:40 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f51b5a80-feae-4b73-98fa-4176572e8b1f
Aug 26 17:08:40 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:40 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f51b5a80-feae-4b73-98fa-4176572e8b1f" returned: 0 in 0.379s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:08:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e6a78b-09e8-44f9-b1ab-c34e85ce0b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51b5a80-feae-4b73-98fa-4176572e8b1f', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3090c7-37ca-4eb2-ad19-e77cae95ec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:08:40 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Volume volume-f51b5a80-feae-4b73-98fa-4176572e8b1f (f51b5a80-feae-4b73-98fa-4176572e8b1f): created successfully
Aug 26 17:08:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3090c7-37ca-4eb2-ad19-e77cae95ec69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:08:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Flow 'volume_create_manager' (d9f23e58-d0cc-4573-986d-5088dc447608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:08:40 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-db7382a6-ad85-4ca4-baf9-58891300ff24 tempest-VolumeTypesAccessTest-759414003 None] Created volume successfully.
Aug 26 17:08:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Acquiring lock "cinder-f51b5a80-feae-4b73-98fa-4176572e8b1f-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:08:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Lock "cinder-f51b5a80-feae-4b73-98fa-4176572e8b1f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:08:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Acquiring lock "cinder-quobyte-f51b5a80-feae-4b73-98fa-4176572e8b1f" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:08:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Lock "cinder-quobyte-f51b5a80-feae-4b73-98fa-4176572e8b1f" acquired by "delete_volume" :: waited 0.031s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:08:41 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[083bfd83-6680-488d-bda9-7911c5220d77]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:08:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f51b5a80-feae-4b73-98fa-4176572e8b1f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:41 devstack sudo[100752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f51b5a80-feae-4b73-98fa-4176572e8b1f
Aug 26 17:08:41 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:42 devstack sudo[100758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:08:42 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:42 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f51b5a80-feae-4b73-98fa-4176572e8b1f" returned: 0 in 0.713s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f51b5a80-feae-4b73-98fa-4176572e8b1f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:42 devstack sudo[100763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f51b5a80-feae-4b73-98fa-4176572e8b1f
Aug 26 17:08:42 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:42 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.509s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 28 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:08:42 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f51b5a80-feae-4b73-98fa-4176572e8b1f" returned: 0 in 0.629s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Lock "cinder-quobyte-f51b5a80-feae-4b73-98fa-4176572e8b1f" released by "delete_volume" :: held 1.428s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:08:43 devstack cinder-volume[94125]: WARNING cinder.quota [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1958748617 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1958748617, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:08:43 devstack cinder-volume[94125]: WARNING cinder.quota [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1958748617 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1958748617, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:08:43 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Created reservations ['058f8eb9-d87c-451e-a5d2-71f0612c7d60', '5c91cd5d-c1c6-4866-936a-ad0bc615f8a0', '8f8f738e-8631-440c-9da6-dcb78698c032', '711d7f46-1e2e-4f86-a3bc-5a45fa96f4e1'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:08:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:08:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:08:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:08:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:08:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:08:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:08:43 devstack sudo[100789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:08:43 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:08:44 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root
Aug 26 17:08:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.782s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:08:44 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:08:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Deleted volume successfully.
Aug 26 17:08:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cbcc3ea7-6e02-44ed-9110-426d0dcdb20d tempest-VolumeTypesAccessTest-759414003 None] Lock "cinder-f51b5a80-feae-4b73-98fa-4176572e8b1f-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:08:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-b768802e-e046-41ba-89c7-70043d2ed835 req-16f566c1-4ab8-4eb9-9579-446237631017 tempest-AttachVolumeShelveTestJSON-310166197 None] No connector for attachment ffb4f466-53c2-428c-b654-64443bd1281f; skipping storage backend terminate_connection call. {{(pid=94125) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Aug 26 17:08:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-b768802e-e046-41ba-89c7-70043d2ed835 req-16f566c1-4ab8-4eb9-9579-446237631017 tempest-AttachVolumeShelveTestJSON-310166197 None] Deleting attachment ffb4f466-53c2-428c-b654-64443bd1281f. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:09:00 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=57,cinder:UPDATE=49,cinder:INSERT=18,cinder:DELETE=6 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:09:00 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=58,cinder:UPDATE=52,cinder:INSERT=17,cinder:DELETE=3 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:09:09 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:09:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Flow 'volume_create_manager' (01f0fc96-e531-40a4-98ca-511c12a95d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:09:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5fc266-f67d-4cbf-ad18-fe99f402f1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5fc266-f67d-4cbf-ad18-fe99f402f1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-211519195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe85351-610b-4d28-9fbe-e5a4496718a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db88b52b48c45c9bb3bd5c7329bf203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:09:09Z,use_quota=True,user_id='85699e7ef3034b24bddc3b92555da29e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f12ac8-ee9f-492f-9d4b-6dc373e24942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f12ac8-ee9f-492f-9d4b-6dc373e24942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34473bb-8920-4456-93f8-287026a46bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:09 devstack cinder-volume[94125]: DEBUG cinder.image.glance [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Creating Keystone auth plugin from conf {{(pid=94125) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 17:09:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34473bb-8920-4456-93f8-287026a46bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ffe85351-610b-4d28-9fbe-e5a4496718a3', 'volume_name': 'volume-ffe85351-610b-4d28-9fbe-e5a4496718a3', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fcbd2630>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64508ed-92c6-4455-b6b4-1589cf546212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64508ed-92c6-4455-b6b4-1589cf546212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3268b10d-f280-4fef-bdb0-2482d0e62164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:10 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Volume ffe85351-610b-4d28-9fbe-e5a4496718a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ffe85351-610b-4d28-9fbe-e5a4496718a3', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fcbd2630>}
Aug 26 17:09:10 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Trying to clone ffe85351-610b-4d28-9fbe-e5a4496718a3 from image b24297bc-5b4d-44da-a168-9014960429c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]). {{(pid=94125) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 17:09:10 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 17:09:10 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Image download 20.69 MB at 20.69 MB/s
Aug 26 17:09:10 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a83710-431a-4e8e-8b71-1a64a9eaf72f]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:10 devstack sudo[101135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD
Aug 26 17:09:10 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:11 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Temporary image b24297bc-5b4d-44da-a168-9014960429c1 is fetched for user 85699e7ef3034b24bddc3b92555da29e. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f24b86-886e-43b8-aa46-c02824411f05]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:11 devstack sudo[101140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD
Aug 26 17:09:11 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:11 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-211519195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe85351-610b-4d28-9fbe-e5a4496718a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db88b52b48c45c9bb3bd5c7329bf203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:09:09Z,use_quota=True,user_id='85699e7ef3034b24bddc3b92555da29e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Creating volume ffe85351-610b-4d28-9fbe-e5a4496718a3 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:09:11 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:09:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:11 devstack sudo[101145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3 1073741824
Aug 26 17:09:11 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:12 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3 1073741824" returned: 0 in 0.534s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:12 devstack sudo[101157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3
Aug 26 17:09:12 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:12 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3" returned: 0 in 0.295s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:09:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:12 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Attempting download of b24297bc-5b4d-44da-a168-9014960429c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}])) to volume ffe85351-610b-4d28-9fbe-e5a4496718a3. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 17:09:12 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f477c4-e78c-4e04-8ddd-997059a2fb99]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_sfyui0rb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:12 devstack sudo[101160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_sfyui0rb
Aug 26 17:09:12 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:13 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_sfyui0rb" returned: 0 in 0.446s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_sfyui0rb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:13 devstack sudo[101166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_sfyui0rb
Aug 26 17:09:13 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:13 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_sfyui0rb" returned: 1 in 0.605s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_sfyui0rb' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:09:13 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b921c3-1e8f-4081-8b2d-d78b97a62d26]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:13 devstack sudo[101173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD
Aug 26 17:09:13 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:14 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:14 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] b24297bc-5b4d-44da-a168-9014960429c1 was qcow2, converting to qcow2 {{(pid=94125) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 17:09:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:14 devstack sudo[101185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3
Aug 26 17:09:14 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:16 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-678131ad-682b-4194-be81-9cb666e6ae27 tempest-ServerActionsTestOtherA-673370039 None] Terminate volume connection completed successfully.
Aug 26 17:09:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-678131ad-682b-4194-be81-9cb666e6ae27 tempest-ServerActionsTestOtherA-673370039 None] Deleting attachment ab93d572-7078-4a6b-af59-81834b282d33. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:09:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "cinder-d7a21e37-5e75-4da8-8ae7-d3636a615e15-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Lock "cinder-d7a21e37-5e75-4da8-8ae7-d3636a615e15-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "cinder-quobyte-d7a21e37-5e75-4da8-8ae7-d3636a615e15" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Lock "cinder-quobyte-d7a21e37-5e75-4da8-8ae7-d3636a615e15" acquired by "delete_volume" :: waited 0.030s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:17 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[119e9b47-aa91-43ca-ad3d-98506ccdb07d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:17 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3" returned: 0 in 3.312s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:17 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_iljd8pazdevstack@QuobyteHD, size 112.00 MB, duration 3.32 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:09:17 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Converted 112.00 MB image at 33.78 MB/s
Aug 26 17:09:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:17 devstack sudo[101218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3 1G
Aug 26 17:09:17 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:17 devstack sudo[101217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15
Aug 26 17:09:17 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:18 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3 1G" returned: 0 in 0.462s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Downloaded image b24297bc-5b4d-44da-a168-9014960429c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}])) to volume ffe85351-610b-4d28-9fbe-e5a4496718a3 successfully. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Temporary image b24297bc-5b4d-44da-a168-9014960429c1 for user 85699e7ef3034b24bddc3b92555da29e is deleted. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Marking volume ffe85351-610b-4d28-9fbe-e5a4496718a3 as bootable. {{(pid=94125) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Copying metadata from image b24297bc-5b4d-44da-a168-9014960429c1 to ffe85351-610b-4d28-9fbe-e5a4496718a3. {{(pid=94125) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Creating volume glance metadata for volume ffe85351-610b-4d28-9fbe-e5a4496718a3 backed by image b24297bc-5b4d-44da-a168-9014960429c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94125) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 17:09:18 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15" returned: 0 in 0.569s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:18 devstack sudo[101227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15
Aug 26 17:09:18 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3268b10d-f280-4fef-bdb0-2482d0e62164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe85351-610b-4d28-9fbe-e5a4496718a3', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fcbd2630>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af82084-0868-45ee-b803-c206692c408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:18 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Volume volume-ffe85351-610b-4d28-9fbe-e5a4496718a3 (ffe85351-610b-4d28-9fbe-e5a4496718a3): created successfully
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af82084-0868-45ee-b803-c206692c408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Flow 'volume_create_manager' (01f0fc96-e531-40a4-98ca-511c12a95d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:09:18 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-89b47aa6-46af-4eec-b90d-1839df06a879 tempest-VolumesImageMetadata-1295296801 None] Created volume successfully.
Aug 26 17:09:18 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d7a21e37-5e75-4da8-8ae7-d3636a615e15" returned: 0 in 0.377s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Lock "cinder-quobyte-d7a21e37-5e75-4da8-8ae7-d3636a615e15" released by "delete_volume" :: held 1.053s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.quota [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Created reservations ['ecd871cd-8887-4b88-890a-b8b162a3844e', '115eaca4-40f4-4eba-a49d-26f3bca2fba8', '2e486933-82b6-47c9-92a7-7939ce00cb03', 'ec46d18d-2292-4f8e-afa9-855dd3b82f89'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "cinder-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Lock "cinder-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:18 devstack sudo[101230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:09:18 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "cinder-quobyte-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Lock "cinder-quobyte-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd" acquired by "delete_volume" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4267d70b-d8cc-4911-b475-4a74476ebb32]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:19 devstack sudo[101232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd
Aug 26 17:09:19 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:19 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.334s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG cinder.manager [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:09:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Deleted volume successfully.
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-50b9b3ac-44a3-4bc3-b4d7-8e5b29b855d1 req-da807529-8e39-407a-9319-103a42d5d7b2 tempest-ServerActionsTestOtherA-673370039 None] Lock "cinder-d7a21e37-5e75-4da8-8ae7-d3636a615e15-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:19 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd" returned: 0 in 0.499s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:19 devstack sudo[101238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd
Aug 26 17:09:19 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:19 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd" returned: 0 in 0.320s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Lock "cinder-quobyte-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd" released by "delete_volume" :: held 0.884s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Created reservations ['0553e9e4-494b-40ca-9c3c-c4a8616a3a71', '183b342b-9279-4a1f-9ab8-32b5310dda99', '346b9481-aed8-4840-b2f4-f7667e32c4e5', '1560a97b-e526-459d-8ce0-94caf385660a'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:19 devstack sudo[101242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:09:19 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Acquiring lock "cinder-ffe85351-610b-4d28-9fbe-e5a4496718a3-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Lock "cinder-ffe85351-610b-4d28-9fbe-e5a4496718a3-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Acquiring lock "cinder-quobyte-ffe85351-610b-4d28-9fbe-e5a4496718a3" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Lock "cinder-quobyte-ffe85351-610b-4d28-9fbe-e5a4496718a3" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:20 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:20 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca04b7e-471f-4f12-b410-def408d150b5]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.573s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:20 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:09:20 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Deleted volume successfully.
Aug 26 17:09:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-271d762b-f7bc-44e0-bcc1-75dcc9c8f483 tempest-ServerActionsTestOtherA-673370039 None] Lock "cinder-8dca1d2e-0279-4b3a-8898-4d8b28ff73fd-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:20 devstack sudo[101270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3
Aug 26 17:09:20 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:21 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3" returned: 0 in 0.832s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:21 devstack sudo[101296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3
Aug 26 17:09:21 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:21 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ffe85351-610b-4d28-9fbe-e5a4496718a3" returned: 0 in 0.343s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Lock "cinder-quobyte-ffe85351-610b-4d28-9fbe-e5a4496718a3" released by "delete_volume" :: held 1.263s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:21 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Created reservations ['babe8f3b-eaed-4ef6-91fd-200243ffeedb', 'b14e4b67-afd9-4848-8a8b-1c2495b0eee0', 'd55d5deb-dcab-4a58-845a-24de4ff4a97b', '01994eb6-a4a9-479c-8aec-615d37624322'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:09:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:21 devstack sudo[101299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:09:21 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:22 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.308s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:22 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:09:22 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Deleted volume successfully.
Aug 26 17:09:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a5e3b9fc-3b1b-4cea-b9db-997875c176fe tempest-VolumesImageMetadata-1295296801 None] Lock "cinder-ffe85351-610b-4d28-9fbe-e5a4496718a3-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Flow 'volume_create_manager' (42dbb9f4-c1bb-40a9-b0d1-8c2dad83e078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd2cf3e-da39-410a-be24-ccad58111c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd2cf3e-da39-410a-be24-ccad58111c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1875747207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fb8aa8-df16-4429-8f05-755ea40934da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c816fb79354b699a1c41237a5543fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:09:26Z,use_quota=True,user_id='2a9a5d703b8b40ada2e5822bf4955ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e788219f-db64-4dcd-b679-82951febad20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e788219f-db64-4dcd-b679-82951febad20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f00d5e-212b-47ec-8b35-c64eba52b28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f00d5e-212b-47ec-8b35-c64eba52b28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59fb8aa8-df16-4429-8f05-755ea40934da', 'volume_name': 'volume-59fb8aa8-df16-4429-8f05-755ea40934da', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b28f1a-045b-4817-b313-2115b10d85bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b28f1a-045b-4817-b313-2115b10d85bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c3c90f-6178-40d8-a0ff-e0861f9e9874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:25 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Volume 59fb8aa8-df16-4429-8f05-755ea40934da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59fb8aa8-df16-4429-8f05-755ea40934da', 'volume_size': 1}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1875747207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fb8aa8-df16-4429-8f05-755ea40934da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c816fb79354b699a1c41237a5543fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:09:26Z,use_quota=True,user_id='2a9a5d703b8b40ada2e5822bf4955ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Creating volume 59fb8aa8-df16-4429-8f05-755ea40934da {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:09:25 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:09:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:25 devstack sudo[101321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da 1073741824
Aug 26 17:09:25 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:26 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da 1073741824" returned: 0 in 0.442s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:26 devstack sudo[101326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da
Aug 26 17:09:26 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:26 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da" returned: 0 in 0.278s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:09:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c3c90f-6178-40d8-a0ff-e0861f9e9874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59fb8aa8-df16-4429-8f05-755ea40934da', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971593cc-9f64-47f3-92dd-9356d483fab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:26 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Volume volume-59fb8aa8-df16-4429-8f05-755ea40934da (59fb8aa8-df16-4429-8f05-755ea40934da): created successfully
Aug 26 17:09:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971593cc-9f64-47f3-92dd-9356d483fab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Flow 'volume_create_manager' (42dbb9f4-c1bb-40a9-b0d1-8c2dad83e078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:09:26 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d888567e-d759-4039-87b5-a364021d07bd tempest-VolumesDeleteCascade-1090825366 None] Created volume successfully.
Aug 26 17:09:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] Creating offline snapshot 03077bbd-df53-49e9-bd7f-f849b9e8d518 of volume 59fb8aa8-df16-4429-8f05-755ea40934da {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:09:27 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[61009f37-b4d3-4483-9384-f83aa2ffc279]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:27 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da
Aug 26 17:09:27 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:27 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da" returned: 0 in 0.373s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:27 devstack sudo[101340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 1G
Aug 26 17:09:27 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:27 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 1G" returned: 0 in 0.534s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb8aa8-df16-4429-8f05-755ea40934da -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:28 devstack sudo[101345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb8aa8-df16-4429-8f05-755ea40934da -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518
Aug 26 17:09:28 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:28 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb8aa8-df16-4429-8f05-755ea40934da -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518" returned: 0 in 0.324s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:28 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 is being set with open permissions: ugo+rw
Aug 26 17:09:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:28 devstack sudo[101350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518
Aug 26 17:09:28 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:28 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518" returned: 0 in 0.330s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:28 devstack sudo[101353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.info
Aug 26 17:09:28 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:29 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.info" returned: 0 in 0.330s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:29 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.info is being set with open permissions: ugo+rw
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:29 devstack sudo[101359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.info
Aug 26 17:09:29 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:29 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.info" returned: 0 in 0.287s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0d852347-e3ac-441f-bfa9-f16310ae79c2 tempest-VolumesDeleteCascade-1090825366 None] Create snapshot completed successfully
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Flow 'volume_create_manager' (cd679b2e-54de-4b9d-94b7-974f610b95e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c75308a-6dee-4654-8acf-4c150c3b1d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c75308a-6dee-4654-8acf-4c150c3b1d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-888545205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b663d2-ae2a-41f9-aebe-9ab6866f0386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40d9eaa37df481e80f8968cbfe0cd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:09:30Z,use_quota=True,user_id='7c2139ac359f4f5b8fdc4e432bbe819d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0e1970-f4b1-4c45-81e2-441e9d82c256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0e1970-f4b1-4c45-81e2-441e9d82c256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2168992c-8b5b-4561-aa4b-c0a6cd540326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2168992c-8b5b-4561-aa4b-c0a6cd540326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b663d2-ae2a-41f9-aebe-9ab6866f0386', 'volume_name': 'volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6c984b-747e-4fd1-b62e-27da5fd9f153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6c984b-747e-4fd1-b62e-27da5fd9f153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09000d9-de16-40fc-a541-9f69cb48251d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:29 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Volume 79b663d2-ae2a-41f9-aebe-9ab6866f0386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386', 'volume_size': 1}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-888545205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b663d2-ae2a-41f9-aebe-9ab6866f0386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40d9eaa37df481e80f8968cbfe0cd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:09:30Z,use_quota=True,user_id='7c2139ac359f4f5b8fdc4e432bbe819d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Creating volume 79b663d2-ae2a-41f9-aebe-9ab6866f0386 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:09:29 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:09:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:29 devstack sudo[101362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386 1073741824
Aug 26 17:09:29 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:30 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386 1073741824" returned: 0 in 0.497s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:30 devstack sudo[101368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386
Aug 26 17:09:30 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:30 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386" returned: 0 in 0.296s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.160s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09000d9-de16-40fc-a541-9f69cb48251d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb10a94-0a8c-4083-8aae-88ad8766a11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] Creating offline snapshot ed58e7dc-0210-42fe-93e9-50e593a7cd90 of volume 59fb8aa8-df16-4429-8f05-755ea40934da {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:09:30 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Volume volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386 (79b663d2-ae2a-41f9-aebe-9ab6866f0386): created successfully
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb10a94-0a8c-4083-8aae-88ad8766a11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Flow 'volume_create_manager' (cd679b2e-54de-4b9d-94b7-974f610b95e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[219e7409-39ef-4e5d-acd7-edf31b3c1c3e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:30 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c5189eea-2098-42e5-9a22-da471b0cae16 tempest-AttachVolumeTestJSON-1234581717 None] Created volume successfully.
Aug 26 17:09:30 devstack sudo[101371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518
Aug 26 17:09:30 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:30 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518" returned: 0 in 0.379s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fb8aa8-df16-4429-8f05-755ea40934da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:09:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:31 devstack sudo[101376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 1G
Aug 26 17:09:31 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:31 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 1G" returned: 0 in 0.473s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:31 devstack sudo[101382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90
Aug 26 17:09:31 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:31 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90" returned: 0 in 0.425s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:31 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 is being set with open permissions: ugo+rw
Aug 26 17:09:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:31 devstack sudo[101391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90
Aug 26 17:09:31 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:32 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90" returned: 0 in 0.384s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:32 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-84ed293d-18ad-4212-917d-41ece879c19f tempest-VolumesDeleteCascade-1090825366 None] Create snapshot completed successfully
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-59fb8aa8-df16-4429-8f05-755ea40934da-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-59fb8aa8-df16-4429-8f05-755ea40934da-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Performing cascade delete. {{(pid=94125) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-e104ff0e-36f0-4cbb-a88e-01c46a5c5f04 req-9d71b57a-8717-422a-bf6d-6160fe48f201 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-e104ff0e-36f0-4cbb-a88e-01c46a5c5f04 req-9d71b57a-8717-422a-bf6d-6160fe48f201 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-03077bbd-df53-49e9-bd7f-f849b9e8d518-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-e104ff0e-36f0-4cbb-a88e-01c46a5c5f04 req-9d71b57a-8717-422a-bf6d-6160fe48f201 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-03077bbd-df53-49e9-bd7f-f849b9e8d518-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-quobyte-59fb8aa8-df16-4429-8f05-755ea40934da" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-e104ff0e-36f0-4cbb-a88e-01c46a5c5f04 req-9d71b57a-8717-422a-bf6d-6160fe48f201 tempest-AttachVolumeTestJSON-1234581717 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49a2b604-bf5d-4d28-a2a8-60cc0bd0dee6', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-59fb8aa8-df16-4429-8f05-755ea40934da" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-quobyte-03077bbd-df53-49e9-bd7f-f849b9e8d518" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-03077bbd-df53-49e9-bd7f-f849b9e8d518" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Deleting offline snapshot 03077bbd-df53-49e9-bd7f-f849b9e8d518 of volume 59fb8aa8-df16-4429-8f05-755ea40934da {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] snapshot_file for this snap is: volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d40fff-a041-43bd-910f-f83fe6a3f807]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:32 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-e104ff0e-36f0-4cbb-a88e-01c46a5c5f04 req-9d71b57a-8717-422a-bf6d-6160fe48f201 tempest-AttachVolumeTestJSON-1234581717 None] attachment_update completed successfully.
Aug 26 17:09:33 devstack sudo[101403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518
Aug 26 17:09:33 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:33 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518" returned: 0 in 0.485s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fb8aa8-df16-4429-8f05-755ea40934da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:09:33 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[65603528-6fee-43ff-8ac6-30025b8553f9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:33 devstack sudo[101792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da
Aug 26 17:09:33 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:33 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da" returned: 0 in 0.442s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:33 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[60450462-2134-45a7-a355-4da6a0409933]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:34 devstack sudo[101798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90
Aug 26 17:09:34 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:34 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90" returned: 0 in 0.423s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fb8aa8-df16-4429-8f05-755ea40934da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:09:34 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67874f3-5af9-4371-b410-3a44f7f0b9c8]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:34 devstack sudo[101803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518
Aug 26 17:09:34 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:34 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518" returned: 0 in 0.388s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fb8aa8-df16-4429-8f05-755ea40934da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:09:34 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5667b5-3e5d-4e0d-9833-729a66fb7b8c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:34 devstack sudo[101808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da
Aug 26 17:09:34 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Flow 'volume_create_manager' (de95da43-296c-40a1-ab05-474e1023b274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:09:35 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20d5859-60a7-4b7c-94b5-0289dccdba2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da" returned: 0 in 0.436s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20d5859-60a7-4b7c-94b5-0289dccdba2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1543878666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27864b58-fc78-4efc-b83a-fd6fdece6d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40d9eaa37df481e80f8968cbfe0cd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:09:35Z,use_quota=True,user_id='7c2139ac359f4f5b8fdc4e432bbe819d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:35 devstack sudo[101814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518
Aug 26 17:09:35 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e3c3da-50e8-482f-949b-5c3d0a066993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e3c3da-50e8-482f-949b-5c3d0a066993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812b2dc0-1dc5-4030-9245-df867a6cf75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812b2dc0-1dc5-4030-9245-df867a6cf75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27864b58-fc78-4efc-b83a-fd6fdece6d97', 'volume_name': 'volume-27864b58-fc78-4efc-b83a-fd6fdece6d97', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26c560d-3f38-4cb0-82cc-7e19476a203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26c560d-3f38-4cb0-82cc-7e19476a203e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffd7c1a-bac9-4e5d-8924-f65b059544ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:35 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Volume 27864b58-fc78-4efc-b83a-fd6fdece6d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27864b58-fc78-4efc-b83a-fd6fdece6d97', 'volume_size': 1}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1543878666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27864b58-fc78-4efc-b83a-fd6fdece6d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40d9eaa37df481e80f8968cbfe0cd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:09:35Z,use_quota=True,user_id='7c2139ac359f4f5b8fdc4e432bbe819d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Creating volume 27864b58-fc78-4efc-b83a-fd6fdece6d97 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:09:35 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27864b58-fc78-4efc-b83a-fd6fdece6d97 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:35 devstack sudo[101816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27864b58-fc78-4efc-b83a-fd6fdece6d97 1073741824
Aug 26 17:09:35 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:35 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518" returned: 0 in 0.386s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:35 devstack sudo[101825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518
Aug 26 17:09:35 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:35 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27864b58-fc78-4efc-b83a-fd6fdece6d97 1073741824" returned: 0 in 0.481s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27864b58-fc78-4efc-b83a-fd6fdece6d97 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:35 devstack sudo[101830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27864b58-fc78-4efc-b83a-fd6fdece6d97
Aug 26 17:09:35 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:35 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.03077bbd-df53-49e9-bd7f-f849b9e8d518" returned: 0 in 0.294s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb8aa8-df16-4429-8f05-755ea40934da /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 -F qcow2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:35 devstack sudo[101833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb8aa8-df16-4429-8f05-755ea40934da /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 -F qcow2
Aug 26 17:09:35 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:36 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27864b58-fc78-4efc-b83a-fd6fdece6d97" returned: 0 in 0.352s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffd7c1a-bac9-4e5d-8924-f65b059544ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27864b58-fc78-4efc-b83a-fd6fdece6d97', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f361bf-890b-421b-9dbf-5a77e71ad3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:36 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Volume volume-27864b58-fc78-4efc-b83a-fd6fdece6d97 (27864b58-fc78-4efc-b83a-fd6fdece6d97): created successfully
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f361bf-890b-421b-9dbf-5a77e71ad3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Flow 'volume_create_manager' (de95da43-296c-40a1-ab05-474e1023b274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:09:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b27f25cb-421f-42fd-88aa-a3981624e633 tempest-AttachVolumeTestJSON-1234581717 None] Created volume successfully.
Aug 26 17:09:36 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb8aa8-df16-4429-8f05-755ea40934da /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 -F qcow2" returned: 0 in 0.395s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-03077bbd-df53-49e9-bd7f-f849b9e8d518" released by "_delete_snapshot" :: held 3.474s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-59fb8aa8-df16-4429-8f05-755ea40934da" released by "delete_snapshot" :: held 3.518s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Created reservations ['ec3dc2e2-278b-4c99-8092-0df3ce06b7af', 'a87cb895-ae54-4ba4-8831-3b72a732f082', 'c580ed50-ce91-41b3-b615-732eef813535', '72693e91-1fe4-4a9d-841c-e1fc5a3aa1f6'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:09:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Delete snapshot completed successfully.
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-03077bbd-df53-49e9-bd7f-f849b9e8d518-delete_snapshot" released by "delete_snapshot" :: held 3.693s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-ed58e7dc-0210-42fe-93e9-50e593a7cd90-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-ed58e7dc-0210-42fe-93e9-50e593a7cd90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-quobyte-59fb8aa8-df16-4429-8f05-755ea40934da" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-59fb8aa8-df16-4429-8f05-755ea40934da" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-quobyte-ed58e7dc-0210-42fe-93e9-50e593a7cd90" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-ed58e7dc-0210-42fe-93e9-50e593a7cd90" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Deleting offline snapshot ed58e7dc-0210-42fe-93e9-50e593a7cd90 of volume 59fb8aa8-df16-4429-8f05-755ea40934da {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] snapshot_file for this snap is: volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d0a343-b43c-418b-80c6-2f1e1d64faed]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:36 devstack sudo[101840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90
Aug 26 17:09:36 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:36 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90" returned: 0 in 0.370s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fb8aa8-df16-4429-8f05-755ea40934da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:09:37 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ea501-2932-4a63-b025-be0ede50c0ab]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:37 devstack sudo[101845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da
Aug 26 17:09:37 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:37 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da" returned: 0 in 0.505s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:37 devstack sudo[101854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90
Aug 26 17:09:37 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:38 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90" returned: 0 in 0.488s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:38 devstack sudo[101866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90
Aug 26 17:09:38 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-6a428e46-c495-40ec-83b8-1c1967e48aaa req-a8103328-c58a-47b8-a5d1-2d225b1f4774 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-6a428e46-c495-40ec-83b8-1c1967e48aaa req-a8103328-c58a-47b8-a5d1-2d225b1f4774 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-6a428e46-c495-40ec-83b8-1c1967e48aaa req-a8103328-c58a-47b8-a5d1-2d225b1f4774 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-6a428e46-c495-40ec-83b8-1c1967e48aaa req-a8103328-c58a-47b8-a5d1-2d225b1f4774 tempest-AttachVolumeTestJSON-1234581717 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-27864b58-fc78-4efc-b83a-fd6fdece6d97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5143e253-cf69-4d41-946e-f803e3b455af', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:09:38 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da.ed58e7dc-0210-42fe-93e9-50e593a7cd90" returned: 0 in 0.362s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-ed58e7dc-0210-42fe-93e9-50e593a7cd90" released by "_delete_snapshot" :: held 1.861s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-59fb8aa8-df16-4429-8f05-755ea40934da" released by "delete_snapshot" :: held 1.891s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-6a428e46-c495-40ec-83b8-1c1967e48aaa req-a8103328-c58a-47b8-a5d1-2d225b1f4774 tempest-AttachVolumeTestJSON-1234581717 None] attachment_update completed successfully.
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Created reservations ['8b595d52-06d7-4d5f-a1af-cd6d538b9072', '4f3d4440-764b-46f8-bcc2-4357ed453884', '20cfa625-8ff2-4460-a3ee-bc32c6ec187b', '9064063f-5a81-43c8-8365-0c9d900a9731'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:09:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Delete snapshot completed successfully.
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-ed58e7dc-0210-42fe-93e9-50e593a7cd90-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Snapshots deleted, issuing volume delete {{(pid=94125) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-quobyte-59fb8aa8-df16-4429-8f05-755ea40934da" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-59fb8aa8-df16-4429-8f05-755ea40934da" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1fcfb1-a3f3-4848-825c-5c95d4ce04f4]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:38 devstack sudo[101875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da
Aug 26 17:09:38 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:39 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da" returned: 0 in 0.492s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:39 devstack sudo[101883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da
Aug 26 17:09:39 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:39 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-59fb8aa8-df16-4429-8f05-755ea40934da" returned: 0 in 0.398s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-59fb8aa8-df16-4429-8f05-755ea40934da" released by "delete_volume" :: held 0.972s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:39 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Created reservations ['b469ebab-275c-4ecb-8258-b2e97e8c4adb', '2abc1887-dd2a-4000-9e9a-1a73ab584d6f', '5ddb1fb8-2b2e-4085-895d-f7d7cfd15dde', 'd516c5a1-6d76-4f24-8aae-76a2d8acbd59'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:09:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:39 devstack sudo[101886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:09:39 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:40 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.266s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:40 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:09:40 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Deleted volume successfully.
Aug 26 17:09:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a0bd3dfa-61dd-442e-ad5e-fd6e06956083 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-59fb8aa8-df16-4429-8f05-755ea40934da-delete_volume" released by "delete_volume" :: held 7.426s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Flow 'volume_create_manager' (bdbc745f-cb69-43ef-b324-e4227ed8e9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad820a7-de2e-45e3-b545-a57769974d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad820a7-de2e-45e3-b545-a57769974d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1253160981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ef0049-6ba6-4fc5-83ee-6136f9e2e0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c816fb79354b699a1c41237a5543fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:09:41Z,use_quota=True,user_id='2a9a5d703b8b40ada2e5822bf4955ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfec971-a4a7-4c2a-9c0b-aba07f1e3c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfec971-a4a7-4c2a-9c0b-aba07f1e3c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2a10b2-0a08-4106-9be9-0c580d5afcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2a10b2-0a08-4106-9be9-0c580d5afcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ef0049-6ba6-4fc5-83ee-6136f9e2e0db', 'volume_name': 'volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bade2447-fda6-44f6-b14b-e99f1f5e4cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bade2447-fda6-44f6-b14b-e99f1f5e4cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540d6b8d-5ac9-4c1b-b5c0-c88c84b9b4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:41 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Volume 54ef0049-6ba6-4fc5-83ee-6136f9e2e0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db', 'volume_size': 1}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1253160981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ef0049-6ba6-4fc5-83ee-6136f9e2e0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c816fb79354b699a1c41237a5543fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:09:41Z,use_quota=True,user_id='2a9a5d703b8b40ada2e5822bf4955ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Creating volume 54ef0049-6ba6-4fc5-83ee-6136f9e2e0db {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:09:41 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:41 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-37e19d2f-8fb4-4495-8965-ea475992bf90 req-a86790b0-0827-4b86-bf3c-00f80b0ad487 tempest-AttachVolumeTestJSON-1234581717 None] Terminate volume connection completed successfully.
Aug 26 17:09:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-37e19d2f-8fb4-4495-8965-ea475992bf90 req-a86790b0-0827-4b86-bf3c-00f80b0ad487 tempest-AttachVolumeTestJSON-1234581717 None] Deleting attachment 49a2b604-bf5d-4d28-a2a8-60cc0bd0dee6. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:09:41 devstack sudo[101898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db 1073741824
Aug 26 17:09:41 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:42 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db 1073741824" returned: 0 in 0.642s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:42 devstack sudo[101904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:09:42 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:42 devstack sudo[101906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db
Aug 26 17:09:42 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:42 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.405s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 28 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:09:42 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db" returned: 0 in 0.408s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540d6b8d-5ac9-4c1b-b5c0-c88c84b9b4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f2bca1-4abe-4a37-a46e-6a9db8e6b2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:42 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Volume volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db (54ef0049-6ba6-4fc5-83ee-6136f9e2e0db): created successfully
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f2bca1-4abe-4a37-a46e-6a9db8e6b2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Flow 'volume_create_manager' (bdbc745f-cb69-43ef-b324-e4227ed8e9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:09:42 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d713835d-10ea-4b87-be7c-815dcf666cb4 tempest-VolumesDeleteCascade-1090825366 None] Created volume successfully.
Aug 26 17:09:43 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-4e7d8a50-0023-46a4-80fc-776bdf400fa8 req-c0ef5bde-620d-4927-babf-292929673704 tempest-AttachVolumeTestJSON-1234581717 None] Terminate volume connection completed successfully.
Aug 26 17:09:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-4e7d8a50-0023-46a4-80fc-776bdf400fa8 req-c0ef5bde-620d-4927-babf-292929673704 tempest-AttachVolumeTestJSON-1234581717 None] Deleting attachment 5143e253-cf69-4d41-946e-f803e3b455af. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:09:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] Creating offline snapshot c7bda607-76c4-4f2d-8afe-b6f585359b7c of volume 54ef0049-6ba6-4fc5-83ee-6136f9e2e0db {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:09:43 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[eded0dc6-1603-41a3-af40-d54cc44e48ce]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:43 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db
Aug 26 17:09:43 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:44 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db" returned: 0 in 0.422s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:44 devstack sudo[101949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c 1G
Aug 26 17:09:44 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:44 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c 1G" returned: 0 in 0.595s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:44 devstack sudo[101975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c
Aug 26 17:09:44 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:45 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c" returned: 0 in 0.525s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:45 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c is being set with open permissions: ugo+rw
Aug 26 17:09:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:45 devstack sudo[102002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c
Aug 26 17:09:45 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:45 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c" returned: 0 in 0.432s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:45 devstack sudo[102006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.info
Aug 26 17:09:45 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:45 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.info" returned: 0 in 0.308s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:46 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.info is being set with open permissions: ugo+rw
Aug 26 17:09:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:46 devstack sudo[102011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.info
Aug 26 17:09:46 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:46 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.info" returned: 0 in 0.286s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-684a3c10-e442-4f71-b7c1-f29cd13a7b8c tempest-VolumesDeleteCascade-1090825366 None] Create snapshot completed successfully
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Flow 'volume_create_manager' (01b2a8f4-8fb5-4762-82ea-c17d2305b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a54e24-2643-4302-b7b2-69ee9282fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a54e24-2643-4302-b7b2-69ee9282fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-781300378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0143566f-9819-42ad-81ed-6cea2bf48793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c816fb79354b699a1c41237a5543fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c7bda607-76c4-4f2d-8afe-b6f585359b7c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:09:48Z,use_quota=True,user_id='2a9a5d703b8b40ada2e5822bf4955ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6a7c36-bfeb-4748-a07b-200fa4f24e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6a7c36-bfeb-4748-a07b-200fa4f24e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c00ea8-7a10-4a44-96ce-8ff486eafd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c00ea8-7a10-4a44-96ce-8ff486eafd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0143566f-9819-42ad-81ed-6cea2bf48793', 'volume_name': 'volume-0143566f-9819-42ad-81ed-6cea2bf48793', 'volume_size': 1, 'snapshot_id': 'c7bda607-76c4-4f2d-8afe-b6f585359b7c'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1d89ba-dfc5-4bc9-911a-864d29e5dd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1d89ba-dfc5-4bc9-911a-864d29e5dd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ed9f56-05f8-4a14-902e-3c951d906c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:48 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Volume 0143566f-9819-42ad-81ed-6cea2bf48793: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0143566f-9819-42ad-81ed-6cea2bf48793', 'volume_size': 1, 'snapshot_id': 'c7bda607-76c4-4f2d-8afe-b6f585359b7c'}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-quobyte-c7bda607-76c4-4f2d-8afe-b6f585359b7c-0143566f-9819-42ad-81ed-6cea2bf48793" by "_create_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-c7bda607-76c4-4f2d-8afe-b6f585359b7c-0143566f-9819-42ad-81ed-6cea2bf48793" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Creating volume 0143566f-9819-42ad-81ed-6cea2bf48793 from snapshot c7bda607-76c4-4f2d-8afe-b6f585359b7c {{(pid=94125) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-quobyte-0143566f-9819-42ad-81ed-6cea2bf48793" by "_copy_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-0143566f-9819-42ad-81ed-6cea2bf48793" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] snapshot: c7bda607-76c4-4f2d-8afe-b6f585359b7c, volume: 0143566f-9819-42ad-81ed-6cea2bf48793,  {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bb7fc6-6dba-4da1-bfb5-97af6a58cd2e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:48 devstack sudo[102060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c
Aug 26 17:09:48 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:49 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c" returned: 0 in 0.609s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:09:49 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccadbbc3-6e91-43f5-9f58-b8db6cb22247]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:49 devstack sudo[102067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db
Aug 26 17:09:49 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:49 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db" returned: 0 in 0.448s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 26 17:09:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Creating direct copy from snapshot {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 26 17:09:49 devstack cinder-volume[94125]: DEBUG cinder.utils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Path /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793 not found in is_blk_device check {{(pid=94125) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 26 17:09:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:49 devstack sudo[102073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793
Aug 26 17:09:49 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "cinder-27864b58-fc78-4efc-b83a-fd6fdece6d97-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Lock "cinder-27864b58-fc78-4efc-b83a-fd6fdece6d97-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "cinder-quobyte-27864b58-fc78-4efc-b83a-fd6fdece6d97" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Lock "cinder-quobyte-27864b58-fc78-4efc-b83a-fd6fdece6d97" acquired by "delete_volume" :: waited 0.043s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:52 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f5bd71-e155-4329-8c5a-819cbd8d946d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27864b58-fc78-4efc-b83a-fd6fdece6d97 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:52 devstack sudo[102089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27864b58-fc78-4efc-b83a-fd6fdece6d97
Aug 26 17:09:52 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:53 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27864b58-fc78-4efc-b83a-fd6fdece6d97" returned: 0 in 1.089s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27864b58-fc78-4efc-b83a-fd6fdece6d97 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:53 devstack sudo[102130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27864b58-fc78-4efc-b83a-fd6fdece6d97
Aug 26 17:09:53 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:54 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27864b58-fc78-4efc-b83a-fd6fdece6d97" returned: 0 in 0.932s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Lock "cinder-quobyte-27864b58-fc78-4efc-b83a-fd6fdece6d97" released by "delete_volume" :: held 2.182s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:54 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Created reservations ['a756d649-f564-472a-8081-91a920b9c403', '3f68fd97-c4fe-4633-9f76-d25875489c02', '2407a8f2-ce5e-4a5c-8293-1195b4df061e', '95e1b994-bcaa-418b-b428-cad567908e27'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:09:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:55 devstack sudo[102158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:09:55 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:55 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.531s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:55 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:09:55 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Deleted volume successfully.
Aug 26 17:09:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-40eb28dd-a480-4657-9c24-0e80199c6f0f tempest-AttachVolumeTestJSON-1234581717 None] Lock "cinder-27864b58-fc78-4efc-b83a-fd6fdece6d97-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "cinder-79b663d2-ae2a-41f9-aebe-9ab6866f0386-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Lock "cinder-79b663d2-ae2a-41f9-aebe-9ab6866f0386-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "cinder-quobyte-79b663d2-ae2a-41f9-aebe-9ab6866f0386" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Lock "cinder-quobyte-79b663d2-ae2a-41f9-aebe-9ab6866f0386" acquired by "delete_volume" :: waited 0.038s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:56 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[adffa9cd-0f7e-499f-ba70-8d250540620e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:56 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793" returned: 0 in 7.398s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:56 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db, size 1024.00 MB, duration 7.40 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:09:56 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Converted 1024.00 MB image at 138.39 MB/s
Aug 26 17:09:56 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793 is being set with open permissions: ugo+rw
Aug 26 17:09:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:57 devstack sudo[102187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793
Aug 26 17:09:57 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:57 devstack sudo[102186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386
Aug 26 17:09:57 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Acquiring lock "cinder-b6b468de-7752-49fc-89dd-ed7e48390a7b-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Lock "cinder-b6b468de-7752-49fc-89dd-ed7e48390a7b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Acquiring lock "cinder-quobyte-b6b468de-7752-49fc-89dd-ed7e48390a7b" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Lock "cinder-quobyte-b6b468de-7752-49fc-89dd-ed7e48390a7b" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb267fc-b864-43db-ad2e-30861169f3b5]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b6b468de-7752-49fc-89dd-ed7e48390a7b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:57 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793" returned: 0 in 0.365s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-0143566f-9819-42ad-81ed-6cea2bf48793" released by "_copy_volume_from_snapshot" :: held 8.970s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:57 devstack sudo[102190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b6b468de-7752-49fc-89dd-ed7e48390a7b
Aug 26 17:09:57 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-c7bda607-76c4-4f2d-8afe-b6f585359b7c-0143566f-9819-42ad-81ed-6cea2bf48793" released by "_create_volume_from_snapshot" :: held 9.087s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.107s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:57 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386" returned: 0 in 0.696s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:57 devstack sudo[102199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386
Aug 26 17:09:57 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ed9f56-05f8-4a14-902e-3c951d906c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0143566f-9819-42ad-81ed-6cea2bf48793', 'volume_size': 1, 'snapshot_id': 'c7bda607-76c4-4f2d-8afe-b6f585359b7c'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd28e5f-75e9-46a0-a5f4-1f81773fb64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:09:57 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Volume volume-0143566f-9819-42ad-81ed-6cea2bf48793 (0143566f-9819-42ad-81ed-6cea2bf48793): created successfully
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd28e5f-75e9-46a0-a5f4-1f81773fb64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Flow 'volume_create_manager' (01b2a8f4-8fb5-4762-82ea-c17d2305b33c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:09:57 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8d2dfb20-a5bf-4a0f-abec-dc0e6f0c78ba tempest-VolumesDeleteCascade-1090825366 None] Created volume successfully.
Aug 26 17:09:57 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b6b468de-7752-49fc-89dd-ed7e48390a7b" returned: 0 in 0.723s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b6b468de-7752-49fc-89dd-ed7e48390a7b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:57 devstack sudo[102204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b6b468de-7752-49fc-89dd-ed7e48390a7b
Aug 26 17:09:57 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:58 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-79b663d2-ae2a-41f9-aebe-9ab6866f0386" returned: 0 in 0.538s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Lock "cinder-quobyte-79b663d2-ae2a-41f9-aebe-9ab6866f0386" released by "delete_volume" :: held 1.348s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Created reservations ['47d681e6-e7c6-4110-ad40-544bd63acc63', 'fdaee5d3-9ecd-46e8-a3a5-c7fc33e4f0da', 'b8f6e6c9-0e89-4848-b8cf-ea7906a05c7d', 'ac3f675a-db65-4dd6-a8de-7751e6a7831d'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:58 devstack sudo[102208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:09:58 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:58 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b6b468de-7752-49fc-89dd-ed7e48390a7b" returned: 0 in 0.294s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Lock "cinder-quobyte-b6b468de-7752-49fc-89dd-ed7e48390a7b" released by "delete_volume" :: held 1.092s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Created reservations ['cb73715b-68a9-453f-9c4c-29d7076ac25b', 'c73e2985-7941-49a9-a523-5816a6120566', 'abfa259a-6469-46cb-bcb2-6dcf1016aaf4', '113acc20-94cf-47e3-aa11-2f462d3b9413'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:58 devstack sudo[102210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:09:58 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:58 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.334s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:09:58 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Deleted volume successfully.
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1e30444e-574e-4c83-8e4c-82ea88212701 tempest-AttachVolumeTestJSON-1234581717 None] Lock "cinder-79b663d2-ae2a-41f9-aebe-9ab6866f0386-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:58 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.338s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Performing cascade delete. {{(pid=94125) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Aug 26 17:09:58 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Deleted volume successfully.
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-c7bda607-76c4-4f2d-8afe-b6f585359b7c-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a91f8dcb-64ee-4004-a973-d9de39351869 tempest-AttachVolumeShelveTestJSON-310166197 None] Lock "cinder-b6b468de-7752-49fc-89dd-ed7e48390a7b-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-c7bda607-76c4-4f2d-8afe-b6f585359b7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-quobyte-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-quobyte-c7bda607-76c4-4f2d-8afe-b6f585359b7c" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-c7bda607-76c4-4f2d-8afe-b6f585359b7c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Deleting offline snapshot c7bda607-76c4-4f2d-8afe-b6f585359b7c of volume 54ef0049-6ba6-4fc5-83ee-6136f9e2e0db {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] snapshot_file for this snap is: volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4bde15-a5dc-425a-89c2-7923cf27fe49]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:58 devstack sudo[102214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c
Aug 26 17:09:58 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "cinder-4161bbdf-c3af-472f-a325-a0637b1eae73-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Lock "cinder-4161bbdf-c3af-472f-a325-a0637b1eae73-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "cinder-quobyte-4161bbdf-c3af-472f-a325-a0637b1eae73" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:09:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Lock "cinder-quobyte-4161bbdf-c3af-472f-a325-a0637b1eae73" acquired by "delete_volume" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:09:59 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c" returned: 0 in 0.494s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:09:59 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bd3005-a28b-4e21-8868-31be21371d99]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4161bbdf-c3af-472f-a325-a0637b1eae73 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:59 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de4ed0d-5da3-4e5c-a6b6-c9ebec1d513c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:09:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:59 devstack sudo[102219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4161bbdf-c3af-472f-a325-a0637b1eae73
Aug 26 17:09:59 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:59 devstack sudo[102220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db
Aug 26 17:09:59 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:09:59 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root
Aug 26 17:09:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4161bbdf-c3af-472f-a325-a0637b1eae73" returned: 0 in 0.549s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:09:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4161bbdf-c3af-472f-a325-a0637b1eae73 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:09:59 devstack sudo[102226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4161bbdf-c3af-472f-a325-a0637b1eae73
Aug 26 17:09:59 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:00 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4161bbdf-c3af-472f-a325-a0637b1eae73" returned: 0 in 0.383s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:00 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db" returned: 0 in 0.926s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Lock "cinder-quobyte-4161bbdf-c3af-472f-a325-a0637b1eae73" released by "delete_volume" :: held 1.040s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=106,cinder:SELECT=90,cinder:INSERT=30,cinder:DELETE=4 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=103,cinder:UPDATE=84,cinder:INSERT=27,cinder:DELETE=12 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:10:00 devstack sudo[102232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c
Aug 26 17:10:00 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Created reservations ['3c24bc49-a036-4c70-af8f-3803006f29cc', 'aba162c6-ecdd-48ea-a251-897f003cb666', '43ad669b-fb2f-4f39-9e0e-ec51d4d2b399', '47b280a2-70ec-45e0-bdb8-3e0e251b38c7'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:00 devstack sudo[102234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:10:00 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:00 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c" returned: 0 in 0.519s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:00 devstack sudo[102239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c
Aug 26 17:10:00 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:01 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.510s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:10:01 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Deleted volume successfully.
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-719246c0-8bf8-4499-b68e-95d09dd331b7 tempest-AttachVolumeTestJSON-1234581717 None] Lock "cinder-4161bbdf-c3af-472f-a325-a0637b1eae73-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:01 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db.c7bda607-76c4-4f2d-8afe-b6f585359b7c" returned: 0 in 0.368s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-c7bda607-76c4-4f2d-8afe-b6f585359b7c" released by "_delete_snapshot" :: held 2.433s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db" released by "delete_snapshot" :: held 2.465s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Created reservations ['ff375ad4-d15d-49a8-a117-014cfa7e85ac', '00ab55e1-1b9f-4316-b711-aafbf1779093', '77dc89cb-10cc-4595-9987-8c0773dfd087', '0f529e70-47e4-433d-8c9b-260988a57ea9'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:10:01 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Delete snapshot completed successfully.
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-c7bda607-76c4-4f2d-8afe-b6f585359b7c-delete_snapshot" released by "delete_snapshot" :: held 2.692s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Snapshots deleted, issuing volume delete {{(pid=94125) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-quobyte-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8659ab9-0d5e-4b96-b047-61855afa6972]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:01 devstack sudo[102246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db
Aug 26 17:10:01 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:02 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db" returned: 0 in 0.550s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:02 devstack sudo[102252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db
Aug 26 17:10:02 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:02 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db" returned: 0 in 0.584s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db" released by "delete_volume" :: held 1.243s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:02 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Created reservations ['744be847-ba51-4404-b4cc-acb5646f8b6e', '7c44226f-cc0d-4518-96bc-15a54077fee4', '1906d0aa-2c77-4f7e-ae24-8cbd62f6a996', 'd3222708-4e12-4d8b-9643-0a395786075d'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:10:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:03 devstack sudo[102256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:10:03 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:03 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.545s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:03 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:10:03 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Deleted volume successfully.
Aug 26 17:10:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0cbdbdc9-e4eb-4e5f-a763-a260a2f299ed tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-54ef0049-6ba6-4fc5-83ee-6136f9e2e0db-delete_volume" released by "delete_volume" :: held 4.950s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-0143566f-9819-42ad-81ed-6cea2bf48793-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-0143566f-9819-42ad-81ed-6cea2bf48793-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "cinder-quobyte-0143566f-9819-42ad-81ed-6cea2bf48793" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-0143566f-9819-42ad-81ed-6cea2bf48793" acquired by "delete_volume" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:03 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd3ef65-be62-4b24-9538-93052346359c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:04 devstack sudo[102264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793
Aug 26 17:10:04 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:04 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793" returned: 0 in 0.576s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:04 devstack sudo[102280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793
Aug 26 17:10:04 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:04 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0143566f-9819-42ad-81ed-6cea2bf48793" returned: 0 in 0.285s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-quobyte-0143566f-9819-42ad-81ed-6cea2bf48793" released by "delete_volume" :: held 0.923s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:04 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Created reservations ['cfda9b4b-994d-4d99-9af2-f28ddd2992b2', 'c3cce646-f1f1-48a2-af8c-56c24c4aa97e', '086b398b-9f2d-4054-9b30-e20fe1f3bc6a', 'a1cdd7b8-3094-48a1-85ba-60c2ea2bdb62'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:10:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:04 devstack sudo[102286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:10:04 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:05 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.265s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:05 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:10:05 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Deleted volume successfully.
Aug 26 17:10:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-51c0d629-563f-4737-84bb-86348ac5f9c1 tempest-VolumesDeleteCascade-1090825366 None] Lock "cinder-0143566f-9819-42ad-81ed-6cea2bf48793-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Flow 'volume_create_manager' (18af0d30-855d-4b90-8582-4f823569e36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689a775b-9b2e-4c0f-8fa1-84de2d12f40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689a775b-9b2e-4c0f-8fa1-84de2d12f40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1158347225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d6a94d-58d8-4fc3-ad53-c9297f3181c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a34988a1f7b46108a6012d877b67f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:10:13Z,use_quota=True,user_id='66585590225b4663b0e65f977afa98a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d62aab-1774-4315-bf2f-a3dfe1dadb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d62aab-1774-4315-bf2f-a3dfe1dadb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1a35e4-1988-4d75-8f77-b4abddfb8c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1a35e4-1988-4d75-8f77-b4abddfb8c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d6a94d-58d8-4fc3-ad53-c9297f3181c0', 'volume_name': 'volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91aebf5b-0512-4cb4-9d33-109f78d5e97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91aebf5b-0512-4cb4-9d33-109f78d5e97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2e9f4f-f977-4a13-8daf-04d1bcdd7522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:13 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Volume b1d6a94d-58d8-4fc3-ad53-c9297f3181c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0', 'volume_size': 1}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1158347225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d6a94d-58d8-4fc3-ad53-c9297f3181c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a34988a1f7b46108a6012d877b67f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:10:13Z,use_quota=True,user_id='66585590225b4663b0e65f977afa98a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Creating volume b1d6a94d-58d8-4fc3-ad53-c9297f3181c0 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:10:13 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:10:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:13 devstack sudo[102410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0 1073741824
Aug 26 17:10:13 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:14 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0 1073741824" returned: 0 in 0.702s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:14 devstack sudo[102416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0
Aug 26 17:10:14 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:14 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0" returned: 0 in 0.344s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:10:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2e9f4f-f977-4a13-8daf-04d1bcdd7522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fcf64b-d438-4ec4-a61c-9dd67f8324de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:14 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Volume volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0 (b1d6a94d-58d8-4fc3-ad53-c9297f3181c0): created successfully
Aug 26 17:10:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fcf64b-d438-4ec4-a61c-9dd67f8324de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Flow 'volume_create_manager' (18af0d30-855d-4b90-8582-4f823569e36f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:10:14 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-31d1d183-3157-4b4b-a110-43a2e334bc8e tempest-VolumesMetadataTest-420706391 None] Created volume successfully.
Aug 26 17:10:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e8c59b14-cc03-4a37-978d-fbc850b4a798 tempest-BackendsCapabilitiesAdminTestsJSON-1301233108 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.723487854004, 'free_capacity_gb': 1774.723487854004, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94125) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 26 17:10:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b41a67fa-8621-4b0c-90c4-038ee3277c7b tempest-BackendsCapabilitiesAdminTestsJSON-1301233108 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.723487854004, 'free_capacity_gb': 1774.723487854004, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94125) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 26 17:10:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Acquiring lock "cinder-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Lock "cinder-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Acquiring lock "cinder-quobyte-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Lock "cinder-quobyte-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:17 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23dd1ac-d6b7-45d5-81a3-5ac079919df2]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:17 devstack sudo[102447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0
Aug 26 17:10:17 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:17 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0" returned: 0 in 0.477s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:17 devstack sudo[102453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0
Aug 26 17:10:17 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:17 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0" returned: 0 in 0.294s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Lock "cinder-quobyte-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0" released by "delete_volume" :: held 0.833s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:17 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Created reservations ['95e7e924-a1ce-484e-ada5-5f42e15e7d4d', 'e5aa67cb-0b0a-44d6-adb3-7a5d97be2112', '4087b785-447d-4b72-a5a6-f7014745a572', 'a4f4662a-7b92-4d08-bee5-bef89697eeed'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:10:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:18 devstack sudo[102458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:10:18 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:18 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.332s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:18 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:10:18 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Deleted volume successfully.
Aug 26 17:10:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3f4538b5-6a8e-44ad-ba07-9900f5f2cdc4 tempest-VolumesMetadataTest-420706391 None] Lock "cinder-b1d6a94d-58d8-4fc3-ad53-c9297f3181c0-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Flow 'volume_create_manager' (78ea8eac-0ff2-44fe-bd40-18724bca1352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c10d109-cfb6-4aba-9137-7e33828ded05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c10d109-cfb6-4aba-9137-7e33828ded05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1290016874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee096b09-5260-4c73-ae6c-8d7013796383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67598111e94945778cea260627dd11cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:10:23Z,use_quota=True,user_id='dc487e5f63124db0ad8c96a735d2753b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df158de-fc5b-4130-8252-22ae8b9dc797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df158de-fc5b-4130-8252-22ae8b9dc797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e5430b-505c-4daf-82b4-4ec00512f4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e5430b-505c-4daf-82b4-4ec00512f4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee096b09-5260-4c73-ae6c-8d7013796383', 'volume_name': 'volume-ee096b09-5260-4c73-ae6c-8d7013796383', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1e5341-f74f-42a4-bee7-e99b92b387bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1e5341-f74f-42a4-bee7-e99b92b387bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b18288-e18b-49f7-86be-43f325f3ef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:22 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Volume ee096b09-5260-4c73-ae6c-8d7013796383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee096b09-5260-4c73-ae6c-8d7013796383', 'volume_size': 1}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1290016874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee096b09-5260-4c73-ae6c-8d7013796383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67598111e94945778cea260627dd11cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:10:23Z,use_quota=True,user_id='dc487e5f63124db0ad8c96a735d2753b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Creating volume ee096b09-5260-4c73-ae6c-8d7013796383 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:10:22 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:10:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ee096b09-5260-4c73-ae6c-8d7013796383 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:22 devstack sudo[102462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ee096b09-5260-4c73-ae6c-8d7013796383 1073741824
Aug 26 17:10:22 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:23 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ee096b09-5260-4c73-ae6c-8d7013796383 1073741824" returned: 0 in 0.709s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ee096b09-5260-4c73-ae6c-8d7013796383 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:23 devstack sudo[102468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ee096b09-5260-4c73-ae6c-8d7013796383
Aug 26 17:10:23 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:24 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ee096b09-5260-4c73-ae6c-8d7013796383" returned: 0 in 0.320s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:10:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:24 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b18288-e18b-49f7-86be-43f325f3ef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee096b09-5260-4c73-ae6c-8d7013796383', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:24 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c1a982-2de4-4369-b9ea-a54dfa891ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:24 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Volume volume-ee096b09-5260-4c73-ae6c-8d7013796383 (ee096b09-5260-4c73-ae6c-8d7013796383): created successfully
Aug 26 17:10:24 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c1a982-2de4-4369-b9ea-a54dfa891ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:24 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Flow 'volume_create_manager' (78ea8eac-0ff2-44fe-bd40-18724bca1352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:10:24 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-58819f92-bef3-48ca-95dd-2ee41c3ad21b tempest-ServersNegativeTestJSON-80224540 None] Created volume successfully.
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Flow 'volume_create_manager' (0484d89f-ed92-4c91-8f8a-550b675b99e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb320bb-987c-4ed8-a397-3a44065b73c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb320bb-987c-4ed8-a397-3a44065b73c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-875328722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24299bd7-22eb-4577-b704-9653b4c6ed2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67598111e94945778cea260627dd11cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:10:27Z,use_quota=True,user_id='dc487e5f63124db0ad8c96a735d2753b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55930286-52a9-4597-80ec-7b721e38aaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55930286-52a9-4597-80ec-7b721e38aaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85aa121-b183-4dde-bc1a-34bc97d85464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85aa121-b183-4dde-bc1a-34bc97d85464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24299bd7-22eb-4577-b704-9653b4c6ed2c', 'volume_name': 'volume-24299bd7-22eb-4577-b704-9653b4c6ed2c', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2028748-838f-427d-b13d-8290123375f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2028748-838f-427d-b13d-8290123375f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a95cf8-ee62-4272-b096-dc9f6ed0ef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:27 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Volume 24299bd7-22eb-4577-b704-9653b4c6ed2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24299bd7-22eb-4577-b704-9653b4c6ed2c', 'volume_size': 1}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-875328722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24299bd7-22eb-4577-b704-9653b4c6ed2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67598111e94945778cea260627dd11cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:10:27Z,use_quota=True,user_id='dc487e5f63124db0ad8c96a735d2753b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Creating volume 24299bd7-22eb-4577-b704-9653b4c6ed2c {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:10:27 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:10:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24299bd7-22eb-4577-b704-9653b4c6ed2c 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:27 devstack sudo[102478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24299bd7-22eb-4577-b704-9653b4c6ed2c 1073741824
Aug 26 17:10:27 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:28 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24299bd7-22eb-4577-b704-9653b4c6ed2c 1073741824" returned: 0 in 0.669s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24299bd7-22eb-4577-b704-9653b4c6ed2c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:28 devstack sudo[102483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24299bd7-22eb-4577-b704-9653b4c6ed2c
Aug 26 17:10:28 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:28 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24299bd7-22eb-4577-b704-9653b4c6ed2c" returned: 0 in 0.286s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:10:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a95cf8-ee62-4272-b096-dc9f6ed0ef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24299bd7-22eb-4577-b704-9653b4c6ed2c', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2253cf6d-d3a2-43d5-9f39-a5d9fe047f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:28 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Volume volume-24299bd7-22eb-4577-b704-9653b4c6ed2c (24299bd7-22eb-4577-b704-9653b4c6ed2c): created successfully
Aug 26 17:10:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2253cf6d-d3a2-43d5-9f39-a5d9fe047f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Flow 'volume_create_manager' (0484d89f-ed92-4c91-8f8a-550b675b99e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:10:28 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-de3aa604-d248-45c9-b216-c63c89e05ba9 tempest-ServersNegativeTestJSON-80224540 None] Created volume successfully.
Aug 26 17:10:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Acquiring lock "cinder-24299bd7-22eb-4577-b704-9653b4c6ed2c-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Lock "cinder-24299bd7-22eb-4577-b704-9653b4c6ed2c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Acquiring lock "cinder-quobyte-24299bd7-22eb-4577-b704-9653b4c6ed2c" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Lock "cinder-quobyte-24299bd7-22eb-4577-b704-9653b4c6ed2c" acquired by "delete_volume" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:30 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f9e311-90b6-4968-80db-a9e650938c28]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24299bd7-22eb-4577-b704-9653b4c6ed2c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:30 devstack sudo[102486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24299bd7-22eb-4577-b704-9653b4c6ed2c
Aug 26 17:10:30 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:31 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24299bd7-22eb-4577-b704-9653b4c6ed2c" returned: 0 in 0.495s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24299bd7-22eb-4577-b704-9653b4c6ed2c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:31 devstack sudo[102491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24299bd7-22eb-4577-b704-9653b4c6ed2c
Aug 26 17:10:31 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:31 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24299bd7-22eb-4577-b704-9653b4c6ed2c" returned: 0 in 0.335s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Lock "cinder-quobyte-24299bd7-22eb-4577-b704-9653b4c6ed2c" released by "delete_volume" :: held 0.920s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:31 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Created reservations ['f9cd7f93-235d-42e0-9b3f-59b6bcca2b01', 'f2e144be-c6f8-48e0-b0fe-54f0f4cbfe88', '8c4b9d45-7701-4ebb-88f2-557e151cdeb6', '1d3e86fc-ca5f-4909-89ed-82131290056e'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:10:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:31 devstack sudo[102494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:10:31 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:32 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.334s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:32 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:10:32 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Deleted volume successfully.
Aug 26 17:10:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e08dbe0-5fc0-4e12-8313-a0834eb4018a tempest-ServersNegativeTestJSON-80224540 None] Lock "cinder-24299bd7-22eb-4577-b704-9653b4c6ed2c-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:32 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b685c6e4-fea6-4d5d-ae52-e51410ce1604 tempest-GroupsV314Test-86605941 None] Group tempest-GroupsV314Test-Group-1324848433: creating
Aug 26 17:10:32 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b685c6e4-fea6-4d5d-ae52-e51410ce1604 tempest-GroupsV314Test-86605941 None] Group tempest-GroupsV314Test-Group-1324848433: created successfully
Aug 26 17:10:32 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b685c6e4-fea6-4d5d-ae52-e51410ce1604 tempest-GroupsV314Test-86605941 None] Create group completed successfully.
Aug 26 17:10:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Acquiring lock "cinder-ee096b09-5260-4c73-ae6c-8d7013796383-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Lock "cinder-ee096b09-5260-4c73-ae6c-8d7013796383-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Acquiring lock "cinder-quobyte-ee096b09-5260-4c73-ae6c-8d7013796383" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Lock "cinder-quobyte-ee096b09-5260-4c73-ae6c-8d7013796383" acquired by "delete_volume" :: waited 0.030s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:32 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[faacb762-badf-4ee0-b685-ae12be813d96]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ee096b09-5260-4c73-ae6c-8d7013796383 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:33 devstack sudo[102500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ee096b09-5260-4c73-ae6c-8d7013796383
Aug 26 17:10:33 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:33 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ee096b09-5260-4c73-ae6c-8d7013796383" returned: 0 in 0.434s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ee096b09-5260-4c73-ae6c-8d7013796383 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:33 devstack sudo[102508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ee096b09-5260-4c73-ae6c-8d7013796383
Aug 26 17:10:33 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:33 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ee096b09-5260-4c73-ae6c-8d7013796383" returned: 0 in 0.492s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Lock "cinder-quobyte-ee096b09-5260-4c73-ae6c-8d7013796383" released by "delete_volume" :: held 0.999s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:33 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Created reservations ['89d2a4f6-c987-49dd-abcf-18b9b111c3a1', 'aa3f812c-2f53-408e-9258-25c34156188f', 'ac70a4fc-fb61-4983-8137-4ff9aef4a5e4', '68d23162-a9c1-42e1-9e1e-d9a3340b0e5d'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:34 devstack sudo[102515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:10:34 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:34 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.376s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:10:34 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Deleted volume successfully.
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Flow 'volume_create_manager' (4ea8688d-d30c-458a-943c-687189d3b3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89448735-88bb-4c86-9d96-2fe4d5be068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89448735-88bb-4c86-9d96-2fe4d5be068b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1856838315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=325b6756-944f-4130-b9ef-f66d070e3303,host='devstack@QuobyteHD#QuobyteHD',id=9a063fff-bd00-430c-97c0-d33e5d2d37b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191772b72c4d43de98cf65b6ea4797fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:10:34Z,use_quota=True,user_id='153bdaed58454b54beef1ff529c38e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5a9ecdd-23ed-4986-ba98-d49d49225632),volume_type_id=a5a9ecdd-23ed-4986-ba98-d49d49225632)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5d5d0d-fd19-455b-9ecf-0dd7ff94401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5d5d0d-fd19-455b-9ecf-0dd7ff94401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17b04d4-2bf8-4491-93fd-718aaf43aaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17b04d4-2bf8-4491-93fd-718aaf43aaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a063fff-bd00-430c-97c0-d33e5d2d37b5', 'volume_name': 'volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d76514-0b12-4ed4-8211-d23dd360b3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d76514-0b12-4ed4-8211-d23dd360b3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5272c674-0281-4e21-b9de-9ec27d711eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:34 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Volume 9a063fff-bd00-430c-97c0-d33e5d2d37b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5', 'volume_size': 1}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=325b6756-944f-4130-b9ef-f66d070e3303,created_at=2026-08-26T15:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1856838315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=325b6756-944f-4130-b9ef-f66d070e3303,host='devstack@QuobyteHD#QuobyteHD',id=9a063fff-bd00-430c-97c0-d33e5d2d37b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191772b72c4d43de98cf65b6ea4797fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:10:34Z,use_quota=True,user_id='153bdaed58454b54beef1ff529c38e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5a9ecdd-23ed-4986-ba98-d49d49225632),volume_type_id=a5a9ecdd-23ed-4986-ba98-d49d49225632)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Creating volume 9a063fff-bd00-430c-97c0-d33e5d2d37b5 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:10:34 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6b87dcaa-de96-45e8-bcb2-a011f8b67768 tempest-ServersNegativeTestJSON-80224540 None] Lock "cinder-ee096b09-5260-4c73-ae6c-8d7013796383-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:34 devstack sudo[102518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 1073741824
Aug 26 17:10:34 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:35 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 1073741824" returned: 0 in 0.736s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:35 devstack sudo[102536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5
Aug 26 17:10:35 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:35 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5" returned: 0 in 0.425s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:10:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5272c674-0281-4e21-b9de-9ec27d711eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8352671d-feea-4151-9f2b-8acaba16dd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:36 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Volume volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 (9a063fff-bd00-430c-97c0-d33e5d2d37b5): created successfully
Aug 26 17:10:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8352671d-feea-4151-9f2b-8acaba16dd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Flow 'volume_create_manager' (4ea8688d-d30c-458a-943c-687189d3b3d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:10:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b332f319-fab8-4554-b9f5-18ede54c263f tempest-GroupsV314Test-86605941 None] Created volume successfully.
Aug 26 17:10:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:37 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Cloning volume 9a063fff-bd00-430c-97c0-d33e5d2d37b5 to volume a84fa86e-ed52-42d3-b3f5-2e1238e38460
Aug 26 17:10:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Creating offline snapshot 067932ca-0a1f-4011-8a30-f8b541c84d71 of volume 9a063fff-bd00-430c-97c0-d33e5d2d37b5 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:10:37 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f282db40-2b3c-4697-8844-ea7bcae456e4]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:38 devstack sudo[102570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5
Aug 26 17:10:38 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:38 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5" returned: 0 in 0.543s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:38 devstack sudo[102576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71 1G
Aug 26 17:10:38 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:39 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71 1G" returned: 0 in 0.560s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:39 devstack sudo[102585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71
Aug 26 17:10:39 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:39 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71" returned: 0 in 0.369s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:39 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71 is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:10:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:39 devstack sudo[102591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71
Aug 26 17:10:39 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:39 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71" returned: 0 in 0.368s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:39 devstack sudo[102594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.info
Aug 26 17:10:39 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:40 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.info" returned: 0 in 0.505s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:40 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:10:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:40 devstack sudo[102616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.info
Aug 26 17:10:40 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:40 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.info" returned: 0 in 0.551s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Acquiring lock "cinder-quobyte-a84fa86e-ed52-42d3-b3f5-2e1238e38460" by "_copy_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Lock "cinder-quobyte-a84fa86e-ed52-42d3-b3f5-2e1238e38460" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] snapshot: 067932ca-0a1f-4011-8a30-f8b541c84d71, volume: a84fa86e-ed52-42d3-b3f5-2e1238e38460,  {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdd1b6f-b4e3-492f-905e-b1164f490b65]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:41 devstack sudo[102653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71
Aug 26 17:10:41 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:41 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71" returned: 0 in 0.541s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[58899d5c-c043-4d3a-bd2e-d19c015dabe8]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:41 devstack sudo[102688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5
Aug 26 17:10:41 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:42 devstack sudo[102690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:10:42 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:42 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5" returned: 0 in 0.677s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Creating direct copy from snapshot {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG cinder.utils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Path /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460 not found in is_blk_device check {{(pid=94125) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:42 devstack sudo[102695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460
Aug 26 17:10:42 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:42 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.578s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 28 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:10:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:10:49 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:10:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Flow 'volume_create_manager' (b1f09a3c-c38a-455d-b302-241e58e4d981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:10:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a421d2e2-aec0-458f-806c-c55891a31bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a421d2e2-aec0-458f-806c-c55891a31bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1576246232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40772b4d-f615-4fac-a3eb-63f8dbc3ef88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b47512f32e14da084973b6f5926aa90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:10:50Z,use_quota=True,user_id='fb938acde6aa4daab2bc576e1a183c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f887eb-0385-4714-afa0-e9d45c17884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f887eb-0385-4714-afa0-e9d45c17884b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7641a8b6-a7af-4322-a411-f370b2a54141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7641a8b6-a7af-4322-a411-f370b2a54141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40772b4d-f615-4fac-a3eb-63f8dbc3ef88', 'volume_name': 'volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f50ced-3495-4103-bbfb-22a7719f8ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f50ced-3495-4103-bbfb-22a7719f8ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d544afba-7d87-4f0b-956c-1b9df7fffc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:50 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Volume 40772b4d-f615-4fac-a3eb-63f8dbc3ef88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88', 'volume_size': 1}
Aug 26 17:10:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:50 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460" returned: 0 in 8.223s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:50 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5, size 1024.00 MB, duration 8.22 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:10:50 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Converted 1024.00 MB image at 124.52 MB/s
Aug 26 17:10:50 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460 is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:10:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:50 devstack sudo[102723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460
Aug 26 17:10:50 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:51 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460" returned: 0 in 0.400s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Lock "cinder-quobyte-a84fa86e-ed52-42d3-b3f5-2e1238e38460" released by "_copy_volume_from_snapshot" :: held 9.991s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Acquiring lock "cinder-quobyte-067932ca-0a1f-4011-8a30-f8b541c84d71" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Lock "cinder-quobyte-067932ca-0a1f-4011-8a30-f8b541c84d71" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:51 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Deleting offline snapshot 067932ca-0a1f-4011-8a30-f8b541c84d71 of volume 9a063fff-bd00-430c-97c0-d33e5d2d37b5 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:10:51 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] snapshot_file for this snap is: volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:10:51 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ec8577-97ea-4981-9f54-a19e0e0fc550]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:51 devstack sudo[102726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71
Aug 26 17:10:51 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:51 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71" returned: 0 in 0.656s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:51 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:10:51 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f970652-e36e-4ece-9ba8-7a782c16b140]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:51 devstack sudo[102732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5
Aug 26 17:10:51 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:52 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5" returned: 0 in 0.615s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:52 devstack sudo[102738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71
Aug 26 17:10:52 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:52 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71" returned: 0 in 0.528s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:52 devstack sudo[102744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71
Aug 26 17:10:52 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:53 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5.067932ca-0a1f-4011-8a30-f8b541c84d71" returned: 0 in 0.275s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Lock "cinder-quobyte-067932ca-0a1f-4011-8a30-f8b541c84d71" released by "_delete_snapshot" :: held 2.191s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.402s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.217s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1576246232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40772b4d-f615-4fac-a3eb-63f8dbc3ef88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b47512f32e14da084973b6f5926aa90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:10:50Z,use_quota=True,user_id='fb938acde6aa4daab2bc576e1a183c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Creating volume 40772b4d-f615-4fac-a3eb-63f8dbc3ef88 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:10:53 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:53 devstack sudo[102747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88 1073741824
Aug 26 17:10:53 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:53 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4685e145-46e7-4ddd-8418-9433c76bdbcf tempest-GroupsV314Test-86605941 None] Create group from source-group-325b6756-944f-4130-b9ef-f66d070e3303 completed successfully.
Aug 26 17:10:53 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88 1073741824" returned: 0 in 0.628s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:53 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88
Aug 26 17:10:53 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:54 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88" returned: 0 in 0.260s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:10:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d544afba-7d87-4f0b-956c-1b9df7fffc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878e1121-40b8-4284-b292-351f9c89a69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:54 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Volume volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88 (40772b4d-f615-4fac-a3eb-63f8dbc3ef88): created successfully
Aug 26 17:10:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878e1121-40b8-4284-b292-351f9c89a69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Flow 'volume_create_manager' (b1f09a3c-c38a-455d-b302-241e58e4d981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:10:54 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-abea9d3f-14bf-457b-a5c8-12e460c4f090 tempest-VolumesSnapshotTestJSON-251792440 None] Created volume successfully.
Aug 26 17:10:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Acquiring lock "cinder-quobyte-a84fa86e-ed52-42d3-b3f5-2e1238e38460" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Lock "cinder-quobyte-a84fa86e-ed52-42d3-b3f5-2e1238e38460" acquired by "delete_volume" :: waited 0.028s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:55 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b32281a-a53e-49f2-9ab8-6d3ab4e79105]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:55 devstack sudo[102757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460
Aug 26 17:10:55 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] Creating offline snapshot 94126a22-1df0-44b4-9196-e790e8068031 of volume 40772b4d-f615-4fac-a3eb-63f8dbc3ef88 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:10:55 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc54a4-05fc-4e22-afcc-f4d321b239a9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:55 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460" returned: 0 in 0.494s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:55 devstack sudo[102760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88
Aug 26 17:10:55 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:55 devstack sudo[102764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460
Aug 26 17:10:55 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:56 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:56 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a84fa86e-ed52-42d3-b3f5-2e1238e38460" returned: 0 in 0.383s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88" returned: 0 in 0.527s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Lock "cinder-quobyte-a84fa86e-ed52-42d3-b3f5-2e1238e38460" released by "delete_volume" :: held 0.965s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:56 devstack sudo[102806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031 1G
Aug 26 17:10:56 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Created reservations ['a7ad193d-c45d-437c-bd02-8329a5e38826'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:10:56 devstack cinder-volume[94125]: WARNING cinder.quota [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-585387149 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-585387149, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:10:56 devstack cinder-volume[94125]: WARNING cinder.quota [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-585387149 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-585387149, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Created reservations ['ac2b16b8-fcec-4956-9c86-364af282308a', '45afe3c2-4985-42c2-82c5-b2248dcd1ffa', '27a75a95-a027-4ab8-be68-0db9e26f3854', '4e24f1b2-6aa6-434c-8448-74832a7aff5a'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:56 devstack sudo[102812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:10:56 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:56 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031 1G" returned: 0 in 0.556s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:56 devstack sudo[102814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031
Aug 26 17:10:56 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:56 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.290s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:10:56 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ed94e606-f228-44b6-a713-72505eefcd98 tempest-GroupsV314Test-86605941 None] Delete group completed successfully.
Aug 26 17:10:56 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031" returned: 0 in 0.315s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:56 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031 is being set with open permissions: ugo+rw
Aug 26 17:10:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:56 devstack sudo[102820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031
Aug 26 17:10:56 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:57 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031" returned: 0 in 0.248s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:57 devstack sudo[102823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.info
Aug 26 17:10:57 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:57 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.info" returned: 0 in 0.267s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:57 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.info is being set with open permissions: ugo+rw
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:57 devstack sudo[102826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.info
Aug 26 17:10:57 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Flow 'volume_create_manager' (85fdcf04-ad00-44c0-8f8d-2707f130cdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:10:57 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e7950c-a0f5-43d0-89ae-7430bd3c495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.info" returned: 0 in 0.318s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.345s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e7950c-a0f5-43d0-89ae-7430bd3c495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-512594190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12b6c28-8231-48af-ab96-132ffdb681be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71adab3d949438e9223286dddba81af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:10:58Z,use_quota=True,user_id='bc92b4871bca42a8a0739e8c1b07c78b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef65cabf-6e19-452b-9580-de10769f6732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef65cabf-6e19-452b-9580-de10769f6732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec642ac5-e2ba-4d8c-aec4-e6a04950a168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec642ac5-e2ba-4d8c-aec4-e6a04950a168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b12b6c28-8231-48af-ab96-132ffdb681be', 'volume_name': 'volume-b12b6c28-8231-48af-ab96-132ffdb681be', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2e79d4-a67a-4d7d-a77b-ab184d2ee450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2e79d4-a67a-4d7d-a77b-ab184d2ee450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46da393-e2a3-448a-af42-2c3e362afd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:57 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Volume b12b6c28-8231-48af-ab96-132ffdb681be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b12b6c28-8231-48af-ab96-132ffdb681be', 'volume_size': 1}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-512594190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12b6c28-8231-48af-ab96-132ffdb681be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71adab3d949438e9223286dddba81af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:10:58Z,use_quota=True,user_id='bc92b4871bca42a8a0739e8c1b07c78b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Creating volume b12b6c28-8231-48af-ab96-132ffdb681be {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:10:57 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Acquiring lock "cinder-quobyte-9a063fff-bd00-430c-97c0-d33e5d2d37b5" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:58 devstack sudo[102829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be 1073741824
Aug 26 17:10:58 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Lock "cinder-quobyte-9a063fff-bd00-430c-97c0-d33e5d2d37b5" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b4a149-80bf-41a5-8811-19b7f4192f44]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:58 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8ef78c40-d492-4ea6-a8c4-2bfe9adf1ad6 tempest-VolumesSnapshotTestJSON-251792440 None] Create snapshot completed successfully
Aug 26 17:10:58 devstack sudo[102831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5
Aug 26 17:10:58 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:58 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be 1073741824" returned: 0 in 0.413s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:58 devstack sudo[102839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be
Aug 26 17:10:58 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:58 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5" returned: 0 in 0.401s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:58 devstack sudo[102841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5
Aug 26 17:10:58 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:58 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be" returned: 0 in 0.264s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46da393-e2a3-448a-af42-2c3e362afd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b12b6c28-8231-48af-ab96-132ffdb681be', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c094db-f6a0-43d9-9d34-5fcc461802f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:10:58 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9a063fff-bd00-430c-97c0-d33e5d2d37b5" returned: 0 in 0.270s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:58 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Volume volume-b12b6c28-8231-48af-ab96-132ffdb681be (b12b6c28-8231-48af-ab96-132ffdb681be): created successfully
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c094db-f6a0-43d9-9d34-5fcc461802f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Flow 'volume_create_manager' (85fdcf04-ad00-44c0-8f8d-2707f130cdd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Lock "cinder-quobyte-9a063fff-bd00-430c-97c0-d33e5d2d37b5" released by "delete_volume" :: held 0.753s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:10:58 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-ff9f03ff-aebd-48f1-a848-440e1455f09a req-b5f31b59-9ec4-40c6-b9fa-a37f4e9c19b9 tempest-VolumesSnapshotsTestJSON-374473479 None] Created volume successfully.
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-94126a22-1df0-44b4-9196-e790e8068031-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Created reservations ['ccf67aad-b1ff-4324-be46-fde4d6bdea66'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-94126a22-1df0-44b4-9196-e790e8068031-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-40772b4d-f615-4fac-a3eb-63f8dbc3ef88" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-40772b4d-f615-4fac-a3eb-63f8dbc3ef88" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-94126a22-1df0-44b4-9196-e790e8068031" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Created reservations ['a286ffa0-b9cf-4f54-ad5a-9d7c3e9f608d', 'dabbab51-e472-47fb-b015-7aa32c98a049', 'ee8346c7-fb8f-4cfa-9bef-ae5d9196ec7a', 'ef015719-1b3e-49d9-8979-1753da4e1ef8'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-94126a22-1df0-44b4-9196-e790e8068031" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Deleting offline snapshot 94126a22-1df0-44b4-9196-e790e8068031 of volume 40772b4d-f615-4fac-a3eb-63f8dbc3ef88 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:10:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] snapshot_file for this snap is: volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee326034-3c1b-4c95-be2f-89a562499b17]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:59 devstack sudo[102846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031
Aug 26 17:10:59 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:10:59 devstack sudo[102848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:10:59 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] Creating offline snapshot 49d1b441-7fe0-496a-8e40-df690a78b923 of volume b12b6c28-8231-48af-ab96-132ffdb681be {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7929b3e-3790-49f6-acf6-a6cff94a96b8]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:59 devstack sudo[102850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be
Aug 26 17:10:59 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:59 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031" returned: 0 in 0.436s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a2a905-3d6c-4392-a36e-73ba404112c0]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:59 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.320s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:10:59 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b715d5f5-f978-41ca-84bd-4211af057d3d tempest-GroupsV314Test-86605941 None] Delete group completed successfully.
Aug 26 17:10:59 devstack sudo[102856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88
Aug 26 17:10:59 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:59 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be" returned: 0 in 0.400s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:59 devstack sudo[102861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923 1G
Aug 26 17:10:59 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:10:59 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88" returned: 0 in 0.403s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:10:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:10:59 devstack sudo[102866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031
Aug 26 17:10:59 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:00 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923 1G" returned: 0 in 0.426s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b12b6c28-8231-48af-ab96-132ffdb681be -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:00 devstack sudo[102871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b12b6c28-8231-48af-ab96-132ffdb681be -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923
Aug 26 17:11:00 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:00 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031" returned: 0 in 0.401s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:00 devstack sudo[102876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031
Aug 26 17:11:00 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:00 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b12b6c28-8231-48af-ab96-132ffdb681be -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923" returned: 0 in 0.360s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:00 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923 is being set with open permissions: ugo+rw
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:00 devstack sudo[102881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923
Aug 26 17:11:00 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:00 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88.94126a22-1df0-44b4-9196-e790e8068031" returned: 0 in 0.275s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=104,cinder:SELECT=82,cinder:INSERT=25,cinder:DELETE=6 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=78,cinder:INSERT=22,cinder:UPDATE=94,cinder:DELETE=7 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-94126a22-1df0-44b4-9196-e790e8068031" released by "_delete_snapshot" :: held 1.673s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-40772b4d-f615-4fac-a3eb-63f8dbc3ef88" released by "delete_snapshot" :: held 1.709s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:00 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923" returned: 0 in 0.285s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Created reservations ['15010b30-80ac-4fbd-812f-6569684f6bc0', 'a396807e-3a1a-43d9-b0e8-ea8f049e3fa2', '3e493e5c-2c29-4901-9a65-94998ba522dc', '9f5dfda8-03a2-4b35-a9a3-1be91229f929'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:00 devstack sudo[102885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.info
Aug 26 17:11:00 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:00 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Delete snapshot completed successfully.
Aug 26 17:11:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-509a4bf8-ae2b-43ad-a48d-df5256699713 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-94126a22-1df0-44b4-9196-e790e8068031-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:01 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.info" returned: 0 in 0.286s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:01 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.info is being set with open permissions: ugo+rw
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:01 devstack sudo[102888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.info
Aug 26 17:11:01 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:01 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.info" returned: 0 in 0.267s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:01 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-d0a0132a-d6ce-46bd-8a65-b71aa7ab169d req-963c1e2d-4b48-4549-8244-a6a07d3ebc3b tempest-VolumesSnapshotsTestJSON-374473479 None] Create snapshot completed successfully
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Flow 'volume_create_manager' (2651489a-2a8f-470c-90fa-23dc0712b5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3186d3-c6e1-4259-bb2f-62239a30d383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Acquiring lock "cinder-49d1b441-7fe0-496a-8e40-df690a78b923-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3186d3-c6e1-4259-bb2f-62239a30d383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1088373851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6bd09c-47e7-4599-9f8d-dab5a0661610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b47512f32e14da084973b6f5926aa90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:02Z,use_quota=True,user_id='fb938acde6aa4daab2bc576e1a183c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8659b1c4-0ac6-4566-a523-f95a562ab01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8659b1c4-0ac6-4566-a523-f95a562ab01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22478842-4a39-469b-a50e-f66dc909c8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22478842-4a39-469b-a50e-f66dc909c8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db6bd09c-47e7-4599-9f8d-dab5a0661610', 'volume_name': 'volume-db6bd09c-47e7-4599-9f8d-dab5a0661610', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cca363-d38a-4292-a09d-42098ed7188e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cca363-d38a-4292-a09d-42098ed7188e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb380ac-9fff-4bf3-bf68-9265c6dc2dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:01 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Volume db6bd09c-47e7-4599-9f8d-dab5a0661610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db6bd09c-47e7-4599-9f8d-dab5a0661610', 'volume_size': 1}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1088373851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6bd09c-47e7-4599-9f8d-dab5a0661610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b47512f32e14da084973b6f5926aa90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:02Z,use_quota=True,user_id='fb938acde6aa4daab2bc576e1a183c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Creating volume db6bd09c-47e7-4599-9f8d-dab5a0661610 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:11:01 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "cinder-49d1b441-7fe0-496a-8e40-df690a78b923-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Acquiring lock "cinder-quobyte-b12b6c28-8231-48af-ab96-132ffdb681be" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:01 devstack sudo[102891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 1073741824
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "cinder-quobyte-b12b6c28-8231-48af-ab96-132ffdb681be" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Acquiring lock "cinder-quobyte-49d1b441-7fe0-496a-8e40-df690a78b923" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:01 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "cinder-quobyte-49d1b441-7fe0-496a-8e40-df690a78b923" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Deleting offline snapshot 49d1b441-7fe0-496a-8e40-df690a78b923 of volume b12b6c28-8231-48af-ab96-132ffdb681be {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] snapshot_file for this snap is: volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[08179855-c609-4006-b79a-5c8ec6e40c0d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:01 devstack sudo[102893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923
Aug 26 17:11:01 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:02 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 1073741824" returned: 0 in 0.521s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:02 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923" returned: 0 in 0.443s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b12b6c28-8231-48af-ab96-132ffdb681be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4221a78d-8e8f-4f50-ab61-97a50618cc39]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:02 devstack sudo[102903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610
Aug 26 17:11:02 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:02 devstack sudo[102902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be
Aug 26 17:11:02 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:02 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610" returned: 0 in 0.359s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb380ac-9fff-4bf3-bf68-9265c6dc2dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db6bd09c-47e7-4599-9f8d-dab5a0661610', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681cb629-418b-4606-abdb-6822537b3d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:02 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Volume volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 (db6bd09c-47e7-4599-9f8d-dab5a0661610): created successfully
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681cb629-418b-4606-abdb-6822537b3d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:02 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Flow 'volume_create_manager' (2651489a-2a8f-470c-90fa-23dc0712b5ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be" returned: 0 in 0.515s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:02 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f6f8bab1-fc70-44fa-836e-c402a36cd934 tempest-VolumesSnapshotTestJSON-251792440 None] Created volume successfully.
Aug 26 17:11:02 devstack sudo[102910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923
Aug 26 17:11:02 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:03 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923" returned: 0 in 0.411s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:03 devstack sudo[102916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923
Aug 26 17:11:03 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:03 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be.49d1b441-7fe0-496a-8e40-df690a78b923" returned: 0 in 0.285s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "cinder-quobyte-49d1b441-7fe0-496a-8e40-df690a78b923" released by "_delete_snapshot" :: held 1.768s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "cinder-quobyte-b12b6c28-8231-48af-ab96-132ffdb681be" released by "delete_snapshot" :: held 1.796s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:03 devstack cinder-volume[94125]: DEBUG cinder.quota [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Created reservations ['a13d477d-1555-4236-aae2-877d55036f00', '006105bc-0073-432b-9a0f-38513bedef60', '0f2f0f01-6d92-4233-8caf-48383d63c91d', '420070e7-9f9d-4a47-910b-1731bb007390'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:03 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Delete snapshot completed successfully.
Aug 26 17:11:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-4ff01796-f088-40a9-a39c-56c4a49aa746 req-c3822e33-be43-44df-8891-c039f05889d6 tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "cinder-49d1b441-7fe0-496a-8e40-df690a78b923-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Acquiring lock "cinder-b12b6c28-8231-48af-ab96-132ffdb681be-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "cinder-b12b6c28-8231-48af-ab96-132ffdb681be-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] Creating offline snapshot 5043f753-23a5-4b54-a8fa-3fa75f0b6d23 of volume db6bd09c-47e7-4599-9f8d-dab5a0661610 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Acquiring lock "cinder-quobyte-b12b6c28-8231-48af-ab96-132ffdb681be" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bd683c-5552-4a8e-9d6d-29ddefc2e616]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "cinder-quobyte-b12b6c28-8231-48af-ab96-132ffdb681be" acquired by "delete_volume" :: waited 0.046s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa922309-daab-4231-81e9-43804514b7cd]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:04 devstack sudo[102919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610
Aug 26 17:11:04 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:04 devstack sudo[102921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be
Aug 26 17:11:04 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:04 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610" returned: 0 in 0.437s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:04 devstack sudo[102930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23 1G
Aug 26 17:11:04 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:04 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be" returned: 0 in 0.436s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:04 devstack sudo[102933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be
Aug 26 17:11:04 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:04 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b12b6c28-8231-48af-ab96-132ffdb681be" returned: 0 in 0.292s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "cinder-quobyte-b12b6c28-8231-48af-ab96-132ffdb681be" released by "delete_volume" :: held 0.813s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:04 devstack cinder-volume[94125]: DEBUG cinder.quota [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Created reservations ['56c8cf3b-255d-445a-849a-8b2a4e975161', 'c76a825e-d0d5-4277-b2b8-549617dc9ce6', '97dec175-bd73-48db-b340-8bf6d04c82e1', '5de4465c-5d80-4d4f-b536-985f6c1c1a9b'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:05 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23 1G" returned: 0 in 0.522s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:05 devstack sudo[102940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23
Aug 26 17:11:05 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:05 devstack sudo[102942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:11:05 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:05 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23" returned: 0 in 0.359s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:05 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23 is being set with open permissions: ugo+rw
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:05 devstack sudo[102947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23
Aug 26 17:11:05 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:05 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.373s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG cinder.manager [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:11:05 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Deleted volume successfully.
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-140ebce6-8589-4200-8462-1e14c959586c req-24e88e86-fb25-4ac5-812f-3642328fcc8a tempest-VolumesSnapshotsTestJSON-374473479 None] Lock "cinder-b12b6c28-8231-48af-ab96-132ffdb681be-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:05 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23" returned: 0 in 0.281s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:05 devstack sudo[102954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.info
Aug 26 17:11:05 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:06 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.info" returned: 0 in 0.334s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:06 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.info is being set with open permissions: ugo+rw
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:06 devstack sudo[102957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.info
Aug 26 17:11:06 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:06 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.info" returned: 0 in 0.350s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Flow 'volume_create_manager' (305c07f9-8238-4e29-97f2-f883a7031df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2101197-dfb7-4586-a4a8-a3d4e5a9b535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:06 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c969dfb5-a102-470a-90bf-99f4bd5abe69 tempest-VolumesSnapshotTestJSON-251792440 None] Create snapshot completed successfully
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2101197-dfb7-4586-a4a8-a3d4e5a9b535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1026804084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf4973f-3553-4bdc-b7fa-764af3ba201c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56542fef448b460cb145f319b027b902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:06Z,use_quota=True,user_id='f93a8f4c3ef742f483512f64e9f5f84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca56259-3749-4e5c-887f-bbf02cd03d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca56259-3749-4e5c-887f-bbf02cd03d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9142b4bc-3fe2-41ae-8097-308c0bdcd7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9142b4bc-3fe2-41ae-8097-308c0bdcd7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf4973f-3553-4bdc-b7fa-764af3ba201c', 'volume_name': 'volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061d5b86-99a6-4685-b7bc-be80e3d7fcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061d5b86-99a6-4685-b7bc-be80e3d7fcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcf6ab2-e9de-40c6-bd6a-7614f2fb3f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:06 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Volume 3bf4973f-3553-4bdc-b7fa-764af3ba201c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c', 'volume_size': 1}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1026804084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf4973f-3553-4bdc-b7fa-764af3ba201c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56542fef448b460cb145f319b027b902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:06Z,use_quota=True,user_id='f93a8f4c3ef742f483512f64e9f5f84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Creating volume 3bf4973f-3553-4bdc-b7fa-764af3ba201c {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:11:06 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:06 devstack sudo[102960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c 1073741824
Aug 26 17:11:06 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Flow 'volume_create_manager' (cf410a69-a47b-4c3b-a342-0fb0da506078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ca5ed6-6dff-4059-81f8-970414a3289b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ca5ed6-6dff-4059-81f8-970414a3289b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1514951506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73920447-1974-43a3-a6f1-7db507c640bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90405224b9824d14aaa186182ba41951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:07Z,use_quota=True,user_id='129c67acb7e7418481806c126ad64af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1df86c-765d-43f9-bc35-4ea789132f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1df86c-765d-43f9-bc35-4ea789132f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73400cde-f330-478a-8aa3-7995a3bdcb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73400cde-f330-478a-8aa3-7995a3bdcb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73920447-1974-43a3-a6f1-7db507c640bd', 'volume_name': 'volume-73920447-1974-43a3-a6f1-7db507c640bd', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d111616a-780a-4e97-b809-9927482bc4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d111616a-780a-4e97-b809-9927482bc4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e96e926-19c3-4a3c-abd4-151f622f15b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:06 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Volume 73920447-1974-43a3-a6f1-7db507c640bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73920447-1974-43a3-a6f1-7db507c640bd', 'volume_size': 1}
Aug 26 17:11:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:07 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c 1073741824" returned: 0 in 0.475s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:07 devstack sudo[102966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c
Aug 26 17:11:07 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:07 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c" returned: 0 in 0.291s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1514951506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73920447-1974-43a3-a6f1-7db507c640bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90405224b9824d14aaa186182ba41951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:07Z,use_quota=True,user_id='129c67acb7e7418481806c126ad64af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Creating volume 73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:11:07 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcf6ab2-e9de-40c6-bd6a-7614f2fb3f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:07 devstack sudo[102970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd 1073741824
Aug 26 17:11:07 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c95e12-01ca-4c09-8e4a-82cd6a6af7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:07 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Volume volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c (3bf4973f-3553-4bdc-b7fa-764af3ba201c): created successfully
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c95e12-01ca-4c09-8e4a-82cd6a6af7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Flow 'volume_create_manager' (305c07f9-8238-4e29-97f2-f883a7031df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:07 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-aebd0f9b-1a80-4cbf-9021-8be4910d7610 tempest-AttachVolumeNegativeTest-749108113 None] Created volume successfully.
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Flow 'volume_create_manager' (6562b239-eb7e-4862-96b5-bcd273aa8ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed36a85-0cfe-4ca9-a999-575fb6a046e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:08 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed36a85-0cfe-4ca9-a999-575fb6a046e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-393238783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30d65a8-f09b-43b5-9585-0f2d82b03048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b47512f32e14da084973b6f5926aa90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5043f753-23a5-4b54-a8fa-3fa75f0b6d23,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:08Z,use_quota=True,user_id='fb938acde6aa4daab2bc576e1a183c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9057ec2-0dc4-4eeb-aa24-e430ecf3dfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9057ec2-0dc4-4eeb-aa24-e430ecf3dfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735382ed-051c-4fe5-9479-8ebdc7c5dcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735382ed-051c-4fe5-9479-8ebdc7c5dcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e30d65a8-f09b-43b5-9585-0f2d82b03048', 'volume_name': 'volume-e30d65a8-f09b-43b5-9585-0f2d82b03048', 'volume_size': 2, 'snapshot_id': '5043f753-23a5-4b54-a8fa-3fa75f0b6d23'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d68fc66-aa8a-4442-a843-a1c0e4b8f7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d68fc66-aa8a-4442-a843-a1c0e4b8f7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88885ed-edb4-4ab5-94cf-8ade70689faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:08 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Volume e30d65a8-f09b-43b5-9585-0f2d82b03048: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e30d65a8-f09b-43b5-9585-0f2d82b03048', 'volume_size': 2, 'snapshot_id': '5043f753-23a5-4b54-a8fa-3fa75f0b6d23'}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd 1073741824" returned: 0 in 0.610s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:08 devstack sudo[102976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd
Aug 26 17:11:08 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:08 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd" returned: 0 in 0.277s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.306s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-5043f753-23a5-4b54-a8fa-3fa75f0b6d23-e30d65a8-f09b-43b5-9585-0f2d82b03048" by "_create_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e96e926-19c3-4a3c-abd4-151f622f15b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73920447-1974-43a3-a6f1-7db507c640bd', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb951277-4963-4827-a552-fd22c244920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-5043f753-23a5-4b54-a8fa-3fa75f0b6d23-e30d65a8-f09b-43b5-9585-0f2d82b03048" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Creating volume e30d65a8-f09b-43b5-9585-0f2d82b03048 from snapshot 5043f753-23a5-4b54-a8fa-3fa75f0b6d23 {{(pid=94125) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-e30d65a8-f09b-43b5-9585-0f2d82b03048" by "_copy_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:08 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Volume volume-73920447-1974-43a3-a6f1-7db507c640bd (73920447-1974-43a3-a6f1-7db507c640bd): created successfully
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb951277-4963-4827-a552-fd22c244920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Flow 'volume_create_manager' (cf410a69-a47b-4c3b-a342-0fb0da506078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-e30d65a8-f09b-43b5-9585-0f2d82b03048" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] snapshot: 5043f753-23a5-4b54-a8fa-3fa75f0b6d23, volume: e30d65a8-f09b-43b5-9585-0f2d82b03048,  {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 26 17:11:08 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7200a697-0859-4a1a-90ee-072f61560d03 tempest-SnapshotsActionsTest-1282223262 None] Created volume successfully.
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[caae573d-9d99-4dc2-a192-b7ba57fb7129]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:08 devstack sudo[102983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23
Aug 26 17:11:08 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:09 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23" returned: 0 in 0.584s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db6bd09c-47e7-4599-9f8d-dab5a0661610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1a0bb2-182e-4f0b-b01a-4fff8e17c12f]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:09 devstack sudo[102989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610
Aug 26 17:11:09 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-157a2ac4-0b6e-45d0-ad44-4ee4ff260ea0 req-6f5e71db-982f-4f17-b557-37607c256d41 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:09 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610" returned: 0 in 0.410s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Creating direct copy from snapshot {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.utils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Path /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048 not found in is_blk_device check {{(pid=94125) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:09 devstack sudo[103002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048
Aug 26 17:11:09 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Flow 'volume_create_manager' (89fac4ba-61ac-408a-9280-fc13a335d38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d06ab1-c292-46f0-8d48-c9dc6487c7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d06ab1-c292-46f0-8d48-c9dc6487c7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1360229451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108b1636-c8ba-4d83-be9e-58684d57a123,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='972895f6aa6747d4a2a7d3a994a45495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:10Z,use_quota=True,user_id='57eebc9a520a442aa13e3db57dff6e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeceba41-9a07-4a0d-858d-f2214d3208cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeceba41-9a07-4a0d-858d-f2214d3208cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cfe8f5-3966-4684-bf9d-d3c94ab5616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cfe8f5-3966-4684-bf9d-d3c94ab5616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '108b1636-c8ba-4d83-be9e-58684d57a123', 'volume_name': 'volume-108b1636-c8ba-4d83-be9e-58684d57a123', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25101fc4-8a5a-403d-bddd-8741776daf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25101fc4-8a5a-403d-bddd-8741776daf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c71d970-cbad-4822-ba32-8147f7fd503e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:09 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Volume 108b1636-c8ba-4d83-be9e-58684d57a123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-108b1636-c8ba-4d83-be9e-58684d57a123', 'volume_size': 1}
Aug 26 17:11:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:13 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048" returned: 0 in 4.276s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:13 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:11:13 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Converted 1024.00 MB image at 239.41 MB/s
Aug 26 17:11:13 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048 is being set with open permissions: ugo+rw
Aug 26 17:11:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:13 devstack sudo[103051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048
Aug 26 17:11:13 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:14 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048" returned: 0 in 0.236s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-e30d65a8-f09b-43b5-9585-0f2d82b03048" released by "_copy_volume_from_snapshot" :: held 5.614s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-5043f753-23a5-4b54-a8fa-3fa75f0b6d23-e30d65a8-f09b-43b5-9585-0f2d82b03048" released by "_create_volume_from_snapshot" :: held 5.721s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.764s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.945s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] Creating offline snapshot 2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 of volume 73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88885ed-edb4-4ab5-94cf-8ade70689faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30d65a8-f09b-43b5-9585-0f2d82b03048', 'volume_size': 2, 'snapshot_id': '5043f753-23a5-4b54-a8fa-3fa75f0b6d23'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553b1bce-68c9-4b2a-856d-6fae2956e063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef71886-04df-4eea-aaae-aefc62efc43b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:14 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Volume volume-e30d65a8-f09b-43b5-9585-0f2d82b03048 (e30d65a8-f09b-43b5-9585-0f2d82b03048): created successfully
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553b1bce-68c9-4b2a-856d-6fae2956e063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Flow 'volume_create_manager' (6562b239-eb7e-4862-96b5-bcd273aa8ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:14 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-224b0544-e7d5-4e41-85e8-b95c85548432 tempest-VolumesSnapshotTestJSON-251792440 None] Created volume successfully.
Aug 26 17:11:14 devstack sudo[103055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd
Aug 26 17:11:14 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-e30d65a8-f09b-43b5-9585-0f2d82b03048-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-e30d65a8-f09b-43b5-9585-0f2d82b03048-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:14 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-e30d65a8-f09b-43b5-9585-0f2d82b03048" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd" returned: 0 in 0.377s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-e30d65a8-f09b-43b5-9585-0f2d82b03048" acquired by "delete_volume" :: waited 0.030s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:14 devstack sudo[103060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 1G
Aug 26 17:11:14 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[109406b8-a240-4ced-be49-784e1445dc92]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:14 devstack sudo[103062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048
Aug 26 17:11:14 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:14 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 1G" returned: 0 in 0.377s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:14 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:14 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:14 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048" returned: 0 in 0.368s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:15 devstack sudo[103072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048
Aug 26 17:11:15 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:15 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:15 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e30d65a8-f09b-43b5-9585-0f2d82b03048" returned: 0 in 0.262s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 0.310s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:15 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 is being set with open permissions: ugo+rw
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-e30d65a8-f09b-43b5-9585-0f2d82b03048" released by "delete_volume" :: held 0.676s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:15 devstack sudo[103079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:15 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Created reservations ['c314a65c-dac2-452d-a7e8-45aba34614c0', '31ec1bbc-8cd6-472b-a94c-d491661bcead', '2ce6bddc-9418-4701-b699-8cf7a7fe1f3c', '4bca9827-457f-4958-a800-16ed24ca8fe0'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:15 devstack sudo[103081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:11:15 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:15 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 0.252s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:15 devstack sudo[103084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.info
Aug 26 17:11:15 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:15 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.254s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:11:15 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Deleted volume successfully.
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1caa8e55-7ee6-408f-a64d-2573d69fdf7f tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-e30d65a8-f09b-43b5-9585-0f2d82b03048-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-5043f753-23a5-4b54-a8fa-3fa75f0b6d23-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-5043f753-23a5-4b54-a8fa-3fa75f0b6d23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-db6bd09c-47e7-4599-9f8d-dab5a0661610" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-db6bd09c-47e7-4599-9f8d-dab5a0661610" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-5043f753-23a5-4b54-a8fa-3fa75f0b6d23" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-5043f753-23a5-4b54-a8fa-3fa75f0b6d23" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Deleting offline snapshot 5043f753-23a5-4b54-a8fa-3fa75f0b6d23 of volume db6bd09c-47e7-4599-9f8d-dab5a0661610 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:11:15 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] snapshot_file for this snap is: volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.info" returned: 0 in 0.294s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:15 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.info is being set with open permissions: ugo+rw
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[218b5620-bd7e-4ceb-9085-64d057bf8193]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:15 devstack sudo[103089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.info
Aug 26 17:11:15 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:15 devstack sudo[103090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23
Aug 26 17:11:15 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:16 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.info" returned: 0 in 0.238s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-157a2ac4-0b6e-45d0-ad44-4ee4ff260ea0 req-6f5e71db-982f-4f17-b557-37607c256d41 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.702s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-157a2ac4-0b6e-45d0-ad44-4ee4ff260ea0 req-6f5e71db-982f-4f17-b557-37607c256d41 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.220s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1360229451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108b1636-c8ba-4d83-be9e-58684d57a123,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='972895f6aa6747d4a2a7d3a994a45495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:10Z,use_quota=True,user_id='57eebc9a520a442aa13e3db57dff6e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Creating volume 108b1636-c8ba-4d83-be9e-58684d57a123 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:11:16 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-108b1636-c8ba-4d83-be9e-58684d57a123 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:16 devstack sudo[103094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-108b1636-c8ba-4d83-be9e-58684d57a123 1073741824
Aug 26 17:11:16 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:16 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d1e3d79f-1c4a-40e9-b4f4-029a07468407 tempest-SnapshotsActionsTest-1282223262 None] Create snapshot completed successfully
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-157a2ac4-0b6e-45d0-ad44-4ee4ff260ea0 req-6f5e71db-982f-4f17-b557-37607c256d41 tempest-AttachVolumeNegativeTest-749108113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0deb5aac-3ae5-4d79-a7da-1beca1d0a629', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:11:16 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:16 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-157a2ac4-0b6e-45d0-ad44-4ee4ff260ea0 req-6f5e71db-982f-4f17-b557-37607c256d41 tempest-AttachVolumeNegativeTest-749108113 None] attachment_update completed successfully.
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23" returned: 0 in 0.400s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db6bd09c-47e7-4599-9f8d-dab5a0661610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d01aac-b042-4b90-afbe-da2a09102134]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:16 devstack sudo[103100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610
Aug 26 17:11:16 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:16 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-108b1636-c8ba-4d83-be9e-58684d57a123 1073741824" returned: 0 in 0.530s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-108b1636-c8ba-4d83-be9e-58684d57a123 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:16 devstack sudo[103491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-108b1636-c8ba-4d83-be9e-58684d57a123
Aug 26 17:11:16 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:16 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610" returned: 0 in 0.654s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:17 devstack sudo[103497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23
Aug 26 17:11:17 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:17 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-108b1636-c8ba-4d83-be9e-58684d57a123" returned: 0 in 0.347s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c71d970-cbad-4822-ba32-8147f7fd503e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-108b1636-c8ba-4d83-be9e-58684d57a123', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ea5240-be26-495f-92fa-2f97c9c3bd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:17 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Volume volume-108b1636-c8ba-4d83-be9e-58684d57a123 (108b1636-c8ba-4d83-be9e-58684d57a123): created successfully
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ea5240-be26-495f-92fa-2f97c9c3bd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Flow 'volume_create_manager' (89fac4ba-61ac-408a-9280-fc13a335d38b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:17 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d4dbd9b8-59d9-4480-913b-fab1e4da7202 tempest-VolumesTestJSON-553415324 None] Created volume successfully.
Aug 26 17:11:17 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23" returned: 0 in 0.448s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:17 devstack sudo[103508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23
Aug 26 17:11:17 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] Creating offline snapshot 707c9ad0-9ce5-42da-b323-14ecc0219b6f of volume 73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f36d411-1cf6-4adb-9de8-812f8611dc19]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:17 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610.5043f753-23a5-4b54-a8fa-3fa75f0b6d23" returned: 0 in 0.285s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-5043f753-23a5-4b54-a8fa-3fa75f0b6d23" released by "_delete_snapshot" :: held 1.918s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-db6bd09c-47e7-4599-9f8d-dab5a0661610" released by "delete_snapshot" :: held 1.942s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:17 devstack sudo[103511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:17 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Created reservations ['df5dc605-3914-4881-8511-b477692a6ef0', 'b7999963-bdfe-40af-b230-b781fa3a018f', 'd258eba7-af7d-4ea6-9f51-343d1f0647fa', '91739b55-308f-42b3-bd42-2270abdd9ad9'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:17 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Delete snapshot completed successfully.
Aug 26 17:11:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-db570f02-af60-40e9-adbc-2614c14cf78c tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-5043f753-23a5-4b54-a8fa-3fa75f0b6d23-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-db6bd09c-47e7-4599-9f8d-dab5a0661610-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:18 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 0.485s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-db6bd09c-47e7-4599-9f8d-dab5a0661610-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:18 devstack sudo[103516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f 1G
Aug 26 17:11:18 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-db6bd09c-47e7-4599-9f8d-dab5a0661610" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Flow 'volume_create_manager' (1dfa384d-6353-4ca6-a8d6-db66a7062f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79e18f6-99e1-42a9-b8a2-a4055a76cd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-db6bd09c-47e7-4599-9f8d-dab5a0661610" acquired by "delete_volume" :: waited 0.061s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79e18f6-99e1-42a9-b8a2-a4055a76cd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-23048430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf10bb2-a816-4799-bd80-ad10eb455189,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='972895f6aa6747d4a2a7d3a994a45495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:18Z,use_quota=True,user_id='57eebc9a520a442aa13e3db57dff6e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def85834-7f3f-46af-93dc-565db36b99fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def85834-7f3f-46af-93dc-565db36b99fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540c1651-546a-48d4-a697-d54d523ca925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540c1651-546a-48d4-a697-d54d523ca925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf10bb2-a816-4799-bd80-ad10eb455189', 'volume_name': 'volume-abf10bb2-a816-4799-bd80-ad10eb455189', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c61492-1786-4d2a-b179-3423dea6af55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c61492-1786-4d2a-b179-3423dea6af55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8827f0b-409a-4d53-b72c-ee80a1ae8da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:18 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Volume abf10bb2-a816-4799-bd80-ad10eb455189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf10bb2-a816-4799-bd80-ad10eb455189', 'volume_size': 1}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ca1b74-c674-4bbf-ac3f-0b511483d37c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:18 devstack sudo[103518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610
Aug 26 17:11:18 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:18 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f 1G" returned: 0 in 0.614s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:18 devstack sudo[103526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f
Aug 26 17:11:18 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:18 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610" returned: 0 in 0.470s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:18 devstack sudo[103530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610
Aug 26 17:11:18 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:19 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f" returned: 0 in 0.360s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:19 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f is being set with open permissions: ugo+rw
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:19 devstack sudo[103537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f
Aug 26 17:11:19 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:19 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-db6bd09c-47e7-4599-9f8d-dab5a0661610" returned: 0 in 0.299s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-db6bd09c-47e7-4599-9f8d-dab5a0661610" released by "delete_volume" :: held 0.922s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Created reservations ['24a55082-80b9-4de8-83c9-b487d6d12f0a', 'bcbca9ff-2291-4fd7-8239-709133147a16', 'e57ab564-1e07-45ff-bbc7-2875174ca527', 'ab294585-dd79-428b-96c6-b4a589261cb2'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:19 devstack sudo[103539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:11:19 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:19 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f" returned: 0 in 0.282s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.037s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-23048430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf10bb2-a816-4799-bd80-ad10eb455189,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='972895f6aa6747d4a2a7d3a994a45495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:18Z,use_quota=True,user_id='57eebc9a520a442aa13e3db57dff6e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Creating volume abf10bb2-a816-4799-bd80-ad10eb455189 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:11:19 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-abf10bb2-a816-4799-bd80-ad10eb455189 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:19 devstack sudo[103542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-abf10bb2-a816-4799-bd80-ad10eb455189 1073741824
Aug 26 17:11:19 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7251f3af-8f04-41a8-82ac-b70c7ef36e6d tempest-SnapshotsActionsTest-1282223262 None] Create snapshot completed successfully
Aug 26 17:11:19 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.318s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:11:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Deleted volume successfully.
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-30f36120-a700-48f9-9e3c-32b76ce98376 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-db6bd09c-47e7-4599-9f8d-dab5a0661610-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Acquiring lock "cinder-707c9ad0-9ce5-42da-b323-14ecc0219b6f-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-707c9ad0-9ce5-42da-b323-14ecc0219b6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Acquiring lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Acquiring lock "cinder-quobyte-707c9ad0-9ce5-42da-b323-14ecc0219b6f" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-707c9ad0-9ce5-42da-b323-14ecc0219b6f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Deleting offline snapshot 707c9ad0-9ce5-42da-b323-14ecc0219b6f of volume 73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] snapshot_file for this snap is: volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b3733f-0461-4246-833b-320650002364]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:20 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:20 devstack sudo[103549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f
Aug 26 17:11:20 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-abf10bb2-a816-4799-bd80-ad10eb455189 1073741824" returned: 0 in 0.669s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-abf10bb2-a816-4799-bd80-ad10eb455189 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:20 devstack sudo[103551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-abf10bb2-a816-4799-bd80-ad10eb455189
Aug 26 17:11:20 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Flow 'volume_create_manager' (8275c17c-b837-4897-80ca-e705a4d9704e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27763d5d-6bc8-4c77-9b29-4762aac8b9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27763d5d-6bc8-4c77-9b29-4762aac8b9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2037311134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62b2df3-8088-4d26-976a-1696fee96536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b47512f32e14da084973b6f5926aa90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:20Z,use_quota=True,user_id='fb938acde6aa4daab2bc576e1a183c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb064f47-bbda-449b-b861-585694d0d572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb064f47-bbda-449b-b861-585694d0d572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c03855f-834e-468e-aef1-325c60ea938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c03855f-834e-468e-aef1-325c60ea938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62b2df3-8088-4d26-976a-1696fee96536', 'volume_name': 'volume-f62b2df3-8088-4d26-976a-1696fee96536', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b22a6809-7fba-42b6-b3ad-1c960a7ccd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b22a6809-7fba-42b6-b3ad-1c960a7ccd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d271ff-0aff-461f-b3ef-8eea9859d6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:20 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Volume f62b2df3-8088-4d26-976a-1696fee96536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62b2df3-8088-4d26-976a-1696fee96536', 'volume_size': 1}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:20 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f" returned: 0 in 0.442s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7c9bdb-e891-41d7-89bc-e4448cef5e71]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:20 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-abf10bb2-a816-4799-bd80-ad10eb455189" returned: 0 in 0.314s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.129s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2037311134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62b2df3-8088-4d26-976a-1696fee96536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b47512f32e14da084973b6f5926aa90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:20Z,use_quota=True,user_id='fb938acde6aa4daab2bc576e1a183c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Creating volume f62b2df3-8088-4d26-976a-1696fee96536 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:11:20 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8827f0b-409a-4d53-b72c-ee80a1ae8da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf10bb2-a816-4799-bd80-ad10eb455189', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b22428-f519-4606-9079-3c69c5eaa9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:20 devstack sudo[103558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 1073741824
Aug 26 17:11:20 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:20 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Volume volume-abf10bb2-a816-4799-bd80-ad10eb455189 (abf10bb2-a816-4799-bd80-ad10eb455189): created successfully
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b22428-f519-4606-9079-3c69c5eaa9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Flow 'volume_create_manager' (1dfa384d-6353-4ca6-a8d6-db66a7062f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:20 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f8b2c393-4d06-4ff2-8ed2-4ca868cb3b60 tempest-VolumesTestJSON-553415324 None] Created volume successfully.
Aug 26 17:11:20 devstack sudo[103557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:20 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:20 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 0.422s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:20 devstack sudo[103568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f
Aug 26 17:11:20 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:20 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 1073741824" returned: 0 in 0.496s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:21 devstack sudo[103570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536
Aug 26 17:11:21 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:21 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536" returned: 0 in 0.291s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d271ff-0aff-461f-b3ef-8eea9859d6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62b2df3-8088-4d26-976a-1696fee96536', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:21 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b57998-3e40-450b-9afb-2890e5b6838f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f" returned: 0 in 0.463s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:21 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Volume volume-f62b2df3-8088-4d26-976a-1696fee96536 (f62b2df3-8088-4d26-976a-1696fee96536): created successfully
Aug 26 17:11:21 devstack sudo[103578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f
Aug 26 17:11:21 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b57998-3e40-450b-9afb-2890e5b6838f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Flow 'volume_create_manager' (8275c17c-b837-4897-80ca-e705a4d9704e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:21 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-11b96723-f402-47f4-8982-0a38f90c3287 tempest-VolumesSnapshotTestJSON-251792440 None] Created volume successfully.
Aug 26 17:11:21 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.707c9ad0-9ce5-42da-b323-14ecc0219b6f" returned: 0 in 0.283s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-707c9ad0-9ce5-42da-b323-14ecc0219b6f" released by "_delete_snapshot" :: held 1.727s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" released by "delete_snapshot" :: held 1.765s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Created reservations ['b457f7e0-0ef5-4c09-a953-78f46ec9d4b8', '571323e3-b4c2-47a3-9447-1020cef27ad1', '677956b8-9a35-4a32-9e5e-38ed2dea3a96', '75251c85-4f0a-46f5-b78b-b2c3c47ddbc7'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:21 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Delete snapshot completed successfully.
Aug 26 17:11:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e499f324-8ffc-4943-afd5-7904058991c2 tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-707c9ad0-9ce5-42da-b323-14ecc0219b6f-delete_snapshot" released by "delete_snapshot" :: held 1.988s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Flow 'volume_create_manager' (5952f9d8-8f71-464e-92ad-a17312d98288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e913a1c-7023-4c1d-9f1f-2dfbe94c9cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e913a1c-7023-4c1d-9f1f-2dfbe94c9cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-367731179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed53e5c-5faa-4f80-bdb5-f04cb06457ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='972895f6aa6747d4a2a7d3a994a45495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:22Z,use_quota=True,user_id='57eebc9a520a442aa13e3db57dff6e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e8c12d-2e02-4230-8220-5ce708c7c356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e8c12d-2e02-4230-8220-5ce708c7c356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95aaf77d-a4ed-4cc6-ae26-b1380ebdc46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95aaf77d-a4ed-4cc6-ae26-b1380ebdc46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ed53e5c-5faa-4f80-bdb5-f04cb06457ec', 'volume_name': 'volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381a399e-d9f5-4a6b-93d2-e458498991a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381a399e-d9f5-4a6b-93d2-e458498991a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5708ba61-2640-4f47-9fed-38b8950bd63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:22 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Volume 2ed53e5c-5faa-4f80-bdb5-f04cb06457ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec', 'volume_size': 1}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-367731179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed53e5c-5faa-4f80-bdb5-f04cb06457ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='972895f6aa6747d4a2a7d3a994a45495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:22Z,use_quota=True,user_id='57eebc9a520a442aa13e3db57dff6e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Creating volume 2ed53e5c-5faa-4f80-bdb5-f04cb06457ec {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:11:22 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:22 devstack sudo[103584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec 1073741824
Aug 26 17:11:22 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:22 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec 1073741824" returned: 0 in 0.551s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:22 devstack sudo[103591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec
Aug 26 17:11:22 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:23 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec" returned: 0 in 0.304s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.666s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] Creating offline snapshot 3688ace7-0f74-4cb9-b5b2-05a8e952f4fd of volume 73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5708ba61-2640-4f47-9fed-38b8950bd63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94981943-c43d-45d8-a6a9-2cec0333712e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aea418-401b-4036-a2f8-617461c1b71b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:23 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Volume volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec (2ed53e5c-5faa-4f80-bdb5-f04cb06457ec): created successfully
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94981943-c43d-45d8-a6a9-2cec0333712e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Flow 'volume_create_manager' (5952f9d8-8f71-464e-92ad-a17312d98288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:23 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-43ef8d48-abfb-4798-83e3-1d436ca5c893 tempest-VolumesTestJSON-553415324 None] Created volume successfully.
Aug 26 17:11:23 devstack sudo[103594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:23 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:23 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 0.457s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:23 devstack sudo[103610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd 1G
Aug 26 17:11:23 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:24 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd 1G" returned: 0 in 0.561s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:24 devstack sudo[103622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd
Aug 26 17:11:24 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:24 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd" returned: 0 in 0.332s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:24 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd is being set with open permissions: ugo+rw
Aug 26 17:11:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:24 devstack sudo[103628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd
Aug 26 17:11:24 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:24 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd" returned: 0 in 0.287s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.760s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.294s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] Creating offline snapshot b750ae11-e62f-4538-a146-2b5b186b77cb of volume f62b2df3-8088-4d26-976a-1696fee96536 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:11:24 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21c3bec-1489-44ea-9b1f-43a50e117efd]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:24 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-70b54f70-8867-41f3-ba70-7ecb944f5942 tempest-SnapshotsActionsTest-1282223262 None] Create snapshot completed successfully
Aug 26 17:11:25 devstack sudo[103631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536
Aug 26 17:11:25 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Acquiring lock "cinder-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Lock "cinder-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Acquiring lock "cinder-quobyte-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Lock "cinder-quobyte-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[45829f88-a7cc-42fa-aec4-89dc76d301e6]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:25 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536" returned: 0 in 0.472s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:25 devstack sudo[103638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb 1G
Aug 26 17:11:25 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:25 devstack sudo[103637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec
Aug 26 17:11:25 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:25 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec" returned: 0 in 0.458s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Acquiring lock "cinder-3688ace7-0f74-4cb9-b5b2-05a8e952f4fd-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:25 devstack sudo[103649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-3688ace7-0f74-4cb9-b5b2-05a8e952f4fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:25 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Acquiring lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" acquired by "delete_snapshot" :: waited 0.042s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Acquiring lock "cinder-quobyte-3688ace7-0f74-4cb9-b5b2-05a8e952f4fd" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-3688ace7-0f74-4cb9-b5b2-05a8e952f4fd" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Deleting offline snapshot 3688ace7-0f74-4cb9-b5b2-05a8e952f4fd of volume 73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:11:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] snapshot_file for this snap is: volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[42710fbe-b242-4fd6-bbfd-0b51c0a8826a]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:26 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb 1G" returned: 0 in 0.734s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f62b2df3-8088-4d26-976a-1696fee96536 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:26 devstack sudo[103667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f62b2df3-8088-4d26-976a-1696fee96536 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb
Aug 26 17:11:26 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:26 devstack sudo[103664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd
Aug 26 17:11:26 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:26 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec" returned: 0 in 0.636s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Lock "cinder-quobyte-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec" released by "delete_volume" :: held 1.179s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Created reservations ['fd8da1fc-0e49-4882-817a-d6972a1afcc2', '966e4e6c-45e1-4a52-b87d-fbcdd1c52a6f', '04e12931-d6ab-4552-86ff-37564b10ae31', 'a4e6056e-0108-4fbe-9e31-7f9cf8526bab'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:26 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f62b2df3-8088-4d26-976a-1696fee96536 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb" returned: 0 in 0.658s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:26 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb is being set with open permissions: ugo+rw
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:26 devstack sudo[103690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:11:26 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:26 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd" returned: 0 in 0.789s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:26 devstack sudo[103694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb
Aug 26 17:11:26 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b6f866-8384-4ae1-8ec4-856e3d5be47b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:27 devstack sudo[103696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:27 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:27 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.445s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:11:27 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Deleted volume successfully.
Aug 26 17:11:27 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb" returned: 0 in 0.441s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d221c233-5e65-43f7-bb86-70bb2b3284b4 tempest-VolumesTestJSON-553415324 None] Lock "cinder-2ed53e5c-5faa-4f80-bdb5-f04cb06457ec-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:27 devstack sudo[103717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.info
Aug 26 17:11:27 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:27 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 0.484s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:27 devstack sudo[103722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd
Aug 26 17:11:27 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Acquiring lock "cinder-abf10bb2-a816-4799-bd80-ad10eb455189-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Lock "cinder-abf10bb2-a816-4799-bd80-ad10eb455189-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:27 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.info" returned: 0 in 0.376s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:27 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.info is being set with open permissions: ugo+rw
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:27 devstack sudo[103742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.info
Aug 26 17:11:27 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Acquiring lock "cinder-quobyte-abf10bb2-a816-4799-bd80-ad10eb455189" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Lock "cinder-quobyte-abf10bb2-a816-4799-bd80-ad10eb455189" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cca984a-732e-4d20-a1b1-6bbe77f877a9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-abf10bb2-a816-4799-bd80-ad10eb455189 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:27 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:27 devstack sudo[103744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-abf10bb2-a816-4799-bd80-ad10eb455189
Aug 26 17:11:27 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd" returned: 0 in 0.563s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:27 devstack sudo[103746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd
Aug 26 17:11:27 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:28 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.info" returned: 0 in 0.382s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.217s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:28 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ea7abe14-95c6-4958-a491-db74c0151ce0 tempest-VolumesSnapshotTestJSON-251792440 None] Create snapshot completed successfully
Aug 26 17:11:28 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.3688ace7-0f74-4cb9-b5b2-05a8e952f4fd" returned: 0 in 0.282s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:28 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-abf10bb2-a816-4799-bd80-ad10eb455189" returned: 0 in 0.465s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-abf10bb2-a816-4799-bd80-ad10eb455189 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-3688ace7-0f74-4cb9-b5b2-05a8e952f4fd" released by "_delete_snapshot" :: held 2.342s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" released by "delete_snapshot" :: held 2.393s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:28 devstack sudo[103753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-abf10bb2-a816-4799-bd80-ad10eb455189
Aug 26 17:11:28 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Created reservations ['663dab5f-c8b0-4a75-8fa9-d468d7aa8bb7', '2910ebcf-d1c7-4df3-9051-00a2738df29d', 'd49de0f8-dd18-44d9-a5ad-8fbfcccb42ca', 'f18e0b4e-d87d-4a55-822d-2ce85dd3c13a'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:28 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Delete snapshot completed successfully.
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e62bb4f1-7a67-4477-8e95-9221ea87d522 tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-3688ace7-0f74-4cb9-b5b2-05a8e952f4fd-delete_snapshot" released by "delete_snapshot" :: held 2.603s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:28 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-abf10bb2-a816-4799-bd80-ad10eb455189" returned: 0 in 0.301s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Lock "cinder-quobyte-abf10bb2-a816-4799-bd80-ad10eb455189" released by "delete_volume" :: held 0.830s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Created reservations ['8ff45ad3-4149-4170-9a8c-7aa09c1d0906', '0c71c872-8999-49d4-8155-41c5245dfb3b', 'df7bf7e1-7864-4cbb-a946-141134943aaa', '9e8b8941-cca5-4daf-94f7-3aa3d81a62de'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:28 devstack sudo[103758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:11:28 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Acquiring lock "cinder-108b1636-c8ba-4d83-be9e-58684d57a123-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Lock "cinder-108b1636-c8ba-4d83-be9e-58684d57a123-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Acquiring lock "cinder-quobyte-108b1636-c8ba-4d83-be9e-58684d57a123" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Lock "cinder-quobyte-108b1636-c8ba-4d83-be9e-58684d57a123" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2237449b-367d-4c3f-979d-25245f2149c2]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-108b1636-c8ba-4d83-be9e-58684d57a123 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:29 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.502s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:11:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Deleted volume successfully.
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8d833452-a859-4807-8278-44e0dcd0b7c2 tempest-VolumesTestJSON-553415324 None] Lock "cinder-abf10bb2-a816-4799-bd80-ad10eb455189-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:29 devstack sudo[103761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-108b1636-c8ba-4d83-be9e-58684d57a123
Aug 26 17:11:29 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] Creating offline snapshot ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637 of volume 73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:11:29 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-108b1636-c8ba-4d83-be9e-58684d57a123" returned: 0 in 0.516s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-108b1636-c8ba-4d83-be9e-58684d57a123 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[21253027-4575-4e6b-879b-784b270c4899]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:29 devstack sudo[103766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-108b1636-c8ba-4d83-be9e-58684d57a123
Aug 26 17:11:29 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:29 devstack sudo[103767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:29 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:30 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-108b1636-c8ba-4d83-be9e-58684d57a123" returned: 0 in 0.467s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Lock "cinder-quobyte-108b1636-c8ba-4d83-be9e-58684d57a123" released by "delete_volume" :: held 1.068s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Flow 'volume_create_manager' (a4314ebc-fa7b-4da4-b4dc-82b977fcb496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1f0c59-7cdf-4e82-9cc9-0cc0a6e7a161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Created reservations ['66ac567c-c2a2-474c-83bd-59be4a2e18db', '517eeb32-5c17-4eab-b60d-96151c378d84', 'f6001605-60e8-4874-8713-edd964e2b10c', 'a53941b8-5e44-44d1-8518-9870c62b51fb'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1f0c59-7cdf-4e82-9cc9-0cc0a6e7a161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1360045945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0084a83-0ac0-4a2c-b980-e684b43c8a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b47512f32e14da084973b6f5926aa90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b750ae11-e62f-4538-a146-2b5b186b77cb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:11:30Z,use_quota=True,user_id='fb938acde6aa4daab2bc576e1a183c82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad03dd8-a624-4278-8743-065963e99273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad03dd8-a624-4278-8743-065963e99273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:30 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120459a2-954d-4fe1-99f5-513ac4cddeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120459a2-954d-4fe1-99f5-513ac4cddeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a0084a83-0ac0-4a2c-b980-e684b43c8a7d', 'volume_name': 'volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d', 'volume_size': 1, 'snapshot_id': 'b750ae11-e62f-4538-a146-2b5b186b77cb'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad83289c-ceb0-4310-ba98-6dbde32d4566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad83289c-ceb0-4310-ba98-6dbde32d4566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb90f0e7-4a31-4497-a906-182833209c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:30 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Volume a0084a83-0ac0-4a2c-b980-e684b43c8a7d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d', 'volume_size': 1, 'snapshot_id': 'b750ae11-e62f-4538-a146-2b5b186b77cb'}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 0.733s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:30 devstack sudo[103774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637 1G
Aug 26 17:11:30 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:30 devstack sudo[103776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:11:30 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:30 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.317s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:11:30 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Deleted volume successfully.
Aug 26 17:11:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0c2dd802-453d-4d64-a5f1-1d4fbeea270c tempest-VolumesTestJSON-553415324 None] Lock "cinder-108b1636-c8ba-4d83-be9e-58684d57a123-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:31 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637 1G" returned: 0 in 0.632s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:31 devstack sudo[103783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637
Aug 26 17:11:31 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:31 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637" returned: 0 in 0.414s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:31 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637 is being set with open permissions: ugo+rw
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:31 devstack sudo[103790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637
Aug 26 17:11:31 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:31 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637" returned: 0 in 0.332s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.287s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.391s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-b750ae11-e62f-4538-a146-2b5b186b77cb-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" by "_create_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-b750ae11-e62f-4538-a146-2b5b186b77cb-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Creating volume a0084a83-0ac0-4a2c-b980-e684b43c8a7d from snapshot b750ae11-e62f-4538-a146-2b5b186b77cb {{(pid=94125) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" by "_copy_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:31 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a5e6a607-84a9-489f-9524-ad17da2c7988 tempest-SnapshotsActionsTest-1282223262 None] Create snapshot completed successfully
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] snapshot: b750ae11-e62f-4538-a146-2b5b186b77cb, volume: a0084a83-0ac0-4a2c-b980-e684b43c8a7d,  {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[648e7bd5-70c9-4f75-86da-d3714ba3eb68]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:32 devstack sudo[103794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb
Aug 26 17:11:32 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:32 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb" returned: 0 in 0.459s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f62b2df3-8088-4d26-976a-1696fee96536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[24218c0c-4d87-41fa-bebe-852d2b14c427]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:32 devstack sudo[103799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536
Aug 26 17:11:32 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Acquiring lock "cinder-ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Acquiring lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Acquiring lock "cinder-quobyte-ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Deleting offline snapshot ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637 of volume 73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:11:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] snapshot_file for this snap is: volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:11:33 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6a4268-9b55-4171-a11d-ebcc8a57e9a5]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:33 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536" returned: 0 in 0.544s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 26 17:11:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Creating direct copy from snapshot {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 26 17:11:33 devstack cinder-volume[94125]: DEBUG cinder.utils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Path /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d not found in is_blk_device check {{(pid=94125) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 26 17:11:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:33 devstack sudo[103805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d
Aug 26 17:11:33 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:33 devstack sudo[103804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637
Aug 26 17:11:33 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:33 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637" returned: 0 in 0.497s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:33 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c938b7-a7e2-4a4d-9392-fd2f0eb7eae3]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:34 devstack sudo[103815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:34 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:35 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 1.616s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:35 devstack sudo[103826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637
Aug 26 17:11:35 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:36 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637" returned: 0 in 1.178s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:36 devstack sudo[103858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637
Aug 26 17:11:36 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:37 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637" returned: 0 in 0.831s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637" released by "_delete_snapshot" :: held 4.336s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" released by "delete_snapshot" :: held 4.394s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:37 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Created reservations ['f81e3aac-f137-40e6-9fb1-3b6f1ce83a1c', '87a4e1cb-7fef-45a8-af2e-08eb6c4a4120', '6503565b-bbb0-44e2-8ea5-bb39f4d9f5c7', '63e1bfb3-31b5-4ee0-8afc-ef21adcf1892'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Delete snapshot completed successfully.
Aug 26 17:11:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9457a07-9b12-4bf3-86a5-20f72beac22a tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-ffb0950b-9b96-4cc9-9b6c-6e5bcc3fd637-delete_snapshot" released by "delete_snapshot" :: held 4.870s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:40 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" returned: 0 in 7.170s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536, size 1024.00 MB, duration 7.17 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:11:40 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Converted 1024.00 MB image at 142.80 MB/s
Aug 26 17:11:40 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d is being set with open permissions: ugo+rw
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:40 devstack sudo[103863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d
Aug 26 17:11:40 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:40 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" returned: 0 in 0.285s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" released by "_copy_volume_from_snapshot" :: held 8.574s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-b750ae11-e62f-4538-a146-2b5b186b77cb-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" released by "_create_volume_from_snapshot" :: held 8.684s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.735s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.697s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] Creating offline snapshot da3ef845-ef89-42c3-9bfa-289c33502610 of volume 73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb90f0e7-4a31-4497-a906-182833209c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d', 'volume_size': 1, 'snapshot_id': 'b750ae11-e62f-4538-a146-2b5b186b77cb'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60bf3f5c-9732-4eea-8934-7728a3db6804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2367555d-2a85-4b95-92ba-61a3f239f73e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:40 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Volume volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d (a0084a83-0ac0-4a2c-b980-e684b43c8a7d): created successfully
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60bf3f5c-9732-4eea-8934-7728a3db6804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:11:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Flow 'volume_create_manager' (a4314ebc-fa7b-4da4-b4dc-82b977fcb496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:11:40 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b0222848-fca5-48c5-a830-7e9d9f403cdd tempest-VolumesSnapshotTestJSON-251792440 None] Created volume successfully.
Aug 26 17:11:40 devstack sudo[103866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:40 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:41 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 0.483s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:41 devstack sudo[103886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610 1G
Aug 26 17:11:41 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-a0084a83-0ac0-4a2c-b980-e684b43c8a7d-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:41 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610 1G" returned: 0 in 0.627s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:41 devstack sudo[103893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610
Aug 26 17:11:41 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-a0084a83-0ac0-4a2c-b980-e684b43c8a7d-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:41 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[017d534c-eba7-436e-9ebc-202fcb2b1a50]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:42 devstack sudo[103895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d
Aug 26 17:11:42 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:42 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610" returned: 0 in 0.402s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:42 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610 is being set with open permissions: ugo+rw
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:42 devstack sudo[103900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:11:42 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:42 devstack sudo[103901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610
Aug 26 17:11:42 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:42 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" returned: 0 in 0.412s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:42 devstack sudo[103907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d
Aug 26 17:11:42 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:42 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.344s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:11:42 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610" returned: 0 in 0.329s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 28 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:42 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f427ed73-d6eb-4d37-8e4c-bd658462f808 tempest-SnapshotsActionsTest-1282223262 None] Create snapshot completed successfully
Aug 26 17:11:42 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" returned: 0 in 0.313s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-a0084a83-0ac0-4a2c-b980-e684b43c8a7d" released by "delete_volume" :: held 0.778s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Created reservations ['db5c4707-1eaa-44ac-8eff-7957a3e9ebe6', '717423ca-52bd-4b1b-bf82-1dc9da6e70fc', '6b5d3e45-4caa-4e54-900e-2040dd64527c', 'cd51383a-f548-4926-8181-61211588bc4a'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:42 devstack sudo[103912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:11:42 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-b750ae11-e62f-4538-a146-2b5b186b77cb-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-b750ae11-e62f-4538-a146-2b5b186b77cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-f62b2df3-8088-4d26-976a-1696fee96536" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:43 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Acquiring lock "cinder-da3ef845-ef89-42c3-9bfa-289c33502610-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-f62b2df3-8088-4d26-976a-1696fee96536" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-b750ae11-e62f-4538-a146-2b5b186b77cb" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.340s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-da3ef845-ef89-42c3-9bfa-289c33502610-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Acquiring lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:43 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Deleted volume successfully.
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-b750ae11-e62f-4538-a146-2b5b186b77cb" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Deleting offline snapshot b750ae11-e62f-4538-a146-2b5b186b77cb of volume f62b2df3-8088-4d26-976a-1696fee96536 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] snapshot_file for this snap is: volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e8398797-ee4a-4bf8-a53d-57d8934c952f tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-a0084a83-0ac0-4a2c-b980-e684b43c8a7d-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" acquired by "delete_snapshot" :: waited 0.053s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Acquiring lock "cinder-quobyte-da3ef845-ef89-42c3-9bfa-289c33502610" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03e49fc-6a46-4f3c-b434-fdef19854b16]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-da3ef845-ef89-42c3-9bfa-289c33502610" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Deleting offline snapshot da3ef845-ef89-42c3-9bfa-289c33502610 of volume 73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] snapshot_file for this snap is: volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7487a41-9fc7-4a4b-9d6f-557169438868]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:43 devstack sudo[103915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb
Aug 26 17:11:43 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:43 devstack sudo[103916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610
Aug 26 17:11:43 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:43 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb" returned: 0 in 0.404s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f62b2df3-8088-4d26-976a-1696fee96536(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a96b392-c569-4706-92f9-5e7fbf4edc85]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:43 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610" returned: 0 in 0.395s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd490ac-e5cb-460b-97a0-7650e7a3b6b7]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:43 devstack sudo[103925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536
Aug 26 17:11:43 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:43 devstack sudo[103926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:43 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:44 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 0.399s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:44 devstack sudo[103934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610
Aug 26 17:11:44 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:44 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536" returned: 0 in 0.587s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:44 devstack sudo[103937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb
Aug 26 17:11:44 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:44 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610" returned: 0 in 0.440s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:44 devstack sudo[103946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610
Aug 26 17:11:44 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:44 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb" returned: 0 in 0.383s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:44 devstack sudo[103948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb
Aug 26 17:11:44 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:44 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.da3ef845-ef89-42c3-9bfa-289c33502610" returned: 0 in 0.305s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:44 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536.b750ae11-e62f-4538-a146-2b5b186b77cb" returned: 0 in 0.290s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-da3ef845-ef89-42c3-9bfa-289c33502610" released by "_delete_snapshot" :: held 1.675s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" released by "delete_snapshot" :: held 1.715s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-b750ae11-e62f-4538-a146-2b5b186b77cb" released by "_delete_snapshot" :: held 1.806s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-f62b2df3-8088-4d26-976a-1696fee96536" released by "delete_snapshot" :: held 1.864s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Created reservations ['43036aa8-8d06-455c-a5c7-922722c1417d', '9253dca0-f8cf-4ac0-9b86-5f84d7a27037', 'f395a24b-6622-48d0-a249-12ec04a78f5f', 'ee4a797d-fbd7-45e4-b12d-b6faa639f17b'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Created reservations ['a549d35c-8f88-466d-a972-5028e73f6638', 'f9cd53bb-dcad-4b7e-a907-1997ace23b6e', 'b4e7f9fa-1554-42b8-9e8d-c728236db890', 'a9c913a1-487e-473f-a0f0-70e58569f272'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Delete snapshot completed successfully.
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a9b165aa-463b-4b35-ab86-4009cdb6518b tempest-SnapshotsActionsTest-860292148 None] Lock "cinder-da3ef845-ef89-42c3-9bfa-289c33502610-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Delete snapshot completed successfully.
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-447ef762-f882-4cdd-b07d-a65475d8182c tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-b750ae11-e62f-4538-a146-2b5b186b77cb-delete_snapshot" released by "delete_snapshot" :: held 2.109s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-f62b2df3-8088-4d26-976a-1696fee96536-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-f62b2df3-8088-4d26-976a-1696fee96536-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-f62b2df3-8088-4d26-976a-1696fee96536" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-f62b2df3-8088-4d26-976a-1696fee96536" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d042da3-4f1e-4013-8933-f2c2fc9bda30]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:45 devstack sudo[103960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536
Aug 26 17:11:45 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "cinder-2f3636ab-4f3f-4f28-a7b9-f3a4a7896213-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Lock "cinder-2f3636ab-4f3f-4f28-a7b9-f3a4a7896213-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "cinder-quobyte-2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Lock "cinder-quobyte-2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Deleting offline snapshot 2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 of volume 73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] snapshot_file for this snap is: volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3797854e-3e5c-4133-b04f-65b9200f8a14]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:46 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536" returned: 0 in 0.471s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:46 devstack sudo[103975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536
Aug 26 17:11:46 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:46 devstack sudo[103974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:46 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:46 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f62b2df3-8088-4d26-976a-1696fee96536" returned: 0 in 0.303s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-f62b2df3-8088-4d26-976a-1696fee96536" released by "delete_volume" :: held 0.860s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:46 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 0.422s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73920447-1974-43a3-a6f1-7db507c640bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c551d5e-b5e8-4388-b8d6-1b11eff472df]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Created reservations ['639f8fb4-694d-4a07-836d-44da323a9247', '188e2ec6-a0ef-4c23-acad-78fc5695937f', '511a80cf-c855-4a36-8c73-2c28544271b5', '81bcc1d9-79c2-47a1-a3c1-795e06fd1d35'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:46 devstack sudo[103982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd
Aug 26 17:11:46 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:46 devstack sudo[103984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:11:46 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:46 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.256s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:11:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Deleted volume successfully.
Aug 26 17:11:46 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd" returned: 0 in 0.446s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-88b1ee06-4c4f-4262-a78e-3e6cd7c3b959 tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-f62b2df3-8088-4d26-976a-1696fee96536-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:46 devstack sudo[103990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:46 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:47 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 0.373s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:47 devstack sudo[103995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213
Aug 26 17:11:47 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:47 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd.2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" returned: 0 in 0.243s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Lock "cinder-quobyte-2f3636ab-4f3f-4f28-a7b9-f3a4a7896213" released by "_delete_snapshot" :: held 1.628s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" released by "delete_snapshot" :: held 1.673s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Created reservations ['3f569505-b96b-44b8-b469-bd097010b5f5', 'c37d9425-38a2-497d-aeed-1b2548883adc', '95c2d1bc-4b48-488b-a987-b634e8d462c8', 'd9529a0f-c684-46a8-b1a7-590133e436f0'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:47 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Delete snapshot completed successfully.
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b4407b8a-8986-4240-926d-fa55279f9011 tempest-SnapshotsActionsTest-1282223262 None] Lock "cinder-2f3636ab-4f3f-4f28-a7b9-f3a4a7896213-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-40772b4d-f615-4fac-a3eb-63f8dbc3ef88-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-40772b4d-f615-4fac-a3eb-63f8dbc3ef88-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "cinder-quobyte-40772b4d-f615-4fac-a3eb-63f8dbc3ef88" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-40772b4d-f615-4fac-a3eb-63f8dbc3ef88" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfaf23d-c5db-48fa-aacf-3e5324a14219]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:48 devstack sudo[103998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88
Aug 26 17:11:48 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "cinder-73920447-1974-43a3-a6f1-7db507c640bd-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Lock "cinder-73920447-1974-43a3-a6f1-7db507c640bd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[905941eb-b3e0-4751-8b68-1ca7b65ae96d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:48 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88" returned: 0 in 0.434s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:48 devstack sudo[104004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88
Aug 26 17:11:48 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:48 devstack sudo[104003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd
Aug 26 17:11:48 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:48 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:48 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-40772b4d-f615-4fac-a3eb-63f8dbc3ef88" returned: 0 in 0.370s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd" returned: 0 in 0.438s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-quobyte-40772b4d-f615-4fac-a3eb-63f8dbc3ef88" released by "delete_volume" :: held 0.919s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:48 devstack sudo[104011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd
Aug 26 17:11:48 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:48 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Created reservations ['83d4ee6c-f94c-4b7a-b082-f9c0c0810cbc', '6f0225fa-e01b-4c7f-8773-cc467e9d5b02', 'ff1085ca-b323-4004-815d-e0750f63c47c', 'e4a9852f-c18a-43e8-873a-9a7448e3c41e'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:49 devstack sudo[104013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:11:49 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:49 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-73920447-1974-43a3-a6f1-7db507c640bd" returned: 0 in 0.334s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Lock "cinder-quobyte-73920447-1974-43a3-a6f1-7db507c640bd" released by "delete_volume" :: held 0.878s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Created reservations ['76505c44-8346-4739-b2f7-f3648feb0812', 'bc80bfe4-9e35-41a1-9a4e-2c499940fdc0', 'f6b04e60-400c-4580-bf6a-07b196d79459', 'b904a6d3-e855-498c-9059-566ae837dee6'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:11:49 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.460s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:49 devstack sudo[104017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:11:49 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:11:49 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Deleted volume successfully.
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e6e8f7f5-2653-4cef-99ed-d44429cc175a tempest-VolumesSnapshotTestJSON-251792440 None] Lock "cinder-40772b4d-f615-4fac-a3eb-63f8dbc3ef88-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:49 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.406s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:11:49 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Deleted volume successfully.
Aug 26 17:11:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-57f5fcab-36d6-4ca9-86b2-88ffe3c65cfe tempest-SnapshotsActionsTest-1282223262 None] Lock "cinder-73920447-1974-43a3-a6f1-7db507c640bd-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:11:57 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-ae75d582-c37f-426c-838a-3553519af303 req-adf67b5b-a274-4f01-88fd-816d6a2936cb tempest-AttachVolumeNegativeTest-749108113 None] Terminate volume connection completed successfully.
Aug 26 17:11:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-ae75d582-c37f-426c-838a-3553519af303 req-adf67b5b-a274-4f01-88fd-816d6a2936cb tempest-AttachVolumeNegativeTest-749108113 None] Deleting attachment 0deb5aac-3ae5-4d79-a7da-1beca1d0a629. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:11:59 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=135,cinder:INSERT=44,cinder:UPDATE=178,cinder:DELETE=14 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Flow 'volume_create_manager' (495cddb2-f4b9-4fd4-8239-c1d5920472d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3138e661-8700-4948-b629-7fc2a9a0f610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3138e661-8700-4948-b629-7fc2a9a0f610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1593929880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10c9279-13de-4cc9-8e79-b228e4a19b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efce5d1d3e4245a693133fd33303c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:00Z,use_quota=True,user_id='fb5cd4e7e46241faa86f9bc4514ae86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8075717-7c15-4232-be2f-7eb5edb83857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8075717-7c15-4232-be2f-7eb5edb83857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82a18a5-6779-4c3e-b370-2122c1f9479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82a18a5-6779-4c3e-b370-2122c1f9479f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f10c9279-13de-4cc9-8e79-b228e4a19b34', 'volume_name': 'volume-f10c9279-13de-4cc9-8e79-b228e4a19b34', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b6624b-788b-4ebc-9a8c-5740a0f44bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b6624b-788b-4ebc-9a8c-5740a0f44bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b59080-76b3-4480-b890-6c4e00537bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:00 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Volume f10c9279-13de-4cc9-8e79-b228e4a19b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f10c9279-13de-4cc9-8e79-b228e4a19b34', 'volume_size': 1}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1593929880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10c9279-13de-4cc9-8e79-b228e4a19b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efce5d1d3e4245a693133fd33303c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:00Z,use_quota=True,user_id='fb5cd4e7e46241faa86f9bc4514ae86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Creating volume f10c9279-13de-4cc9-8e79-b228e4a19b34 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:12:00 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f10c9279-13de-4cc9-8e79-b228e4a19b34 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:00 devstack sudo[104087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f10c9279-13de-4cc9-8e79-b228e4a19b34 1073741824
Aug 26 17:12:00 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Flow 'volume_create_manager' (487c995f-8000-4d1f-9bbb-039dbae57a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebffc70-7a33-45e6-9d1e-2b944903dbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebffc70-7a33-45e6-9d1e-2b944903dbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1932825838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd651938-3377-48c5-9f2b-3b841e08c444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b618fe3b6f4993ae550107be0d42e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:00Z,use_quota=True,user_id='14d472534b55450e8a0baa6a25971071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8ca355-fa80-47c0-b400-c2cf74d6e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8ca355-fa80-47c0-b400-c2cf74d6e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749368eb-9dba-410f-a67e-cf2002872792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749368eb-9dba-410f-a67e-cf2002872792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd651938-3377-48c5-9f2b-3b841e08c444', 'volume_name': 'volume-cd651938-3377-48c5-9f2b-3b841e08c444', 'volume_size': 2}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc15a0cf-44fb-46a3-9032-17ca19f859ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc15a0cf-44fb-46a3-9032-17ca19f859ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53afb1bf-dcf3-46e5-99e4-b43176f88028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:00 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Volume cd651938-3377-48c5-9f2b-3b841e08c444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd651938-3377-48c5-9f2b-3b841e08c444', 'volume_size': 2}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:00 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f10c9279-13de-4cc9-8e79-b228e4a19b34 1073741824" returned: 0 in 0.584s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=161,cinder:INSERT=45,cinder:UPDATE=158,cinder:DELETE=13 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:12:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f10c9279-13de-4cc9-8e79-b228e4a19b34 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:00 devstack sudo[104095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f10c9279-13de-4cc9-8e79-b228e4a19b34
Aug 26 17:12:00 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:01 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f10c9279-13de-4cc9-8e79-b228e4a19b34" returned: 0 in 0.305s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.658s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1932825838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd651938-3377-48c5-9f2b-3b841e08c444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b618fe3b6f4993ae550107be0d42e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:00Z,use_quota=True,user_id='14d472534b55450e8a0baa6a25971071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Creating volume cd651938-3377-48c5-9f2b-3b841e08c444 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:12:01 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444 2147483648 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b59080-76b3-4480-b890-6c4e00537bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10c9279-13de-4cc9-8e79-b228e4a19b34', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:01 devstack sudo[104099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444 2147483648
Aug 26 17:12:01 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd0f25b-12b3-4a4c-a316-0d2aa1eb8a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:01 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Volume volume-f10c9279-13de-4cc9-8e79-b228e4a19b34 (f10c9279-13de-4cc9-8e79-b228e4a19b34): created successfully
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd0f25b-12b3-4a4c-a316-0d2aa1eb8a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Flow 'volume_create_manager' (495cddb2-f4b9-4fd4-8239-c1d5920472d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:01 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c9fc0cb1-e480-4615-95b9-98243cbe82c7 tempest-VolumeQuotasAdminTestJSON-147161724 None] Created volume successfully.
Aug 26 17:12:01 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444 2147483648" returned: 0 in 0.674s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:02 devstack sudo[104105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444
Aug 26 17:12:02 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Acquiring lock "cinder-f10c9279-13de-4cc9-8e79-b228e4a19b34-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "cinder-f10c9279-13de-4cc9-8e79-b228e4a19b34-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Acquiring lock "cinder-quobyte-f10c9279-13de-4cc9-8e79-b228e4a19b34" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "cinder-quobyte-f10c9279-13de-4cc9-8e79-b228e4a19b34" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3b0682-02cb-47a7-9652-0212655acc90]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f10c9279-13de-4cc9-8e79-b228e4a19b34 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:02 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444" returned: 0 in 0.312s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53afb1bf-dcf3-46e5-99e4-b43176f88028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd651938-3377-48c5-9f2b-3b841e08c444', 'volume_size': 2}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6156ef-00cf-4c35-a8d7-29ace6c0554d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:02 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Volume volume-cd651938-3377-48c5-9f2b-3b841e08c444 (cd651938-3377-48c5-9f2b-3b841e08c444): created successfully
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6156ef-00cf-4c35-a8d7-29ace6c0554d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Flow 'volume_create_manager' (487c995f-8000-4d1f-9bbb-039dbae57a29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:02 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-46601dfa-29fc-4b46-9037-dd501529fdf7 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Created volume successfully.
Aug 26 17:12:02 devstack sudo[104108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f10c9279-13de-4cc9-8e79-b228e4a19b34
Aug 26 17:12:02 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:02 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f10c9279-13de-4cc9-8e79-b228e4a19b34" returned: 0 in 0.422s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f10c9279-13de-4cc9-8e79-b228e4a19b34 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:02 devstack sudo[104113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f10c9279-13de-4cc9-8e79-b228e4a19b34
Aug 26 17:12:02 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:02 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f10c9279-13de-4cc9-8e79-b228e4a19b34" returned: 0 in 0.282s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "cinder-quobyte-f10c9279-13de-4cc9-8e79-b228e4a19b34" released by "delete_volume" :: held 0.764s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Created reservations ['1679a7a4-0828-4e21-b06d-335e18f40062', '9ebf44b5-e287-4978-8fb5-93a2f3f879f7', '41d71dfe-5e4d-4ebe-94c8-8dc18ab8d4e3', '583ad49f-c011-4d61-adf3-8cd4adc68dbb'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:03 devstack sudo[104116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:12:03 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:03 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.458s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:12:03 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Deleted volume successfully.
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e00c9bea-99c2-4255-b159-4c6098c2fb9d tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "cinder-f10c9279-13de-4cc9-8e79-b228e4a19b34-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Creating offline snapshot 5610dce7-a8d0-4441-b91d-da487100e881 of volume cd651938-3377-48c5-9f2b-3b841e08c444 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d88170-0e68-49e7-a1f5-86da66128388]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:12:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:03 devstack sudo[104119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444
Aug 26 17:12:03 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Flow 'volume_create_manager' (61498165-2ecd-4e9b-984f-9c7820f2d69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f84884-cc9f-465c-bf66-37491198743b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f84884-cc9f-465c-bf66-37491198743b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-948689704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087316ac-bda2-4929-9f22-25444af63a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efce5d1d3e4245a693133fd33303c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:04Z,use_quota=True,user_id='fb5cd4e7e46241faa86f9bc4514ae86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:04 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f32152e-1066-45c5-b237-c67cdd66dbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f32152e-1066-45c5-b237-c67cdd66dbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86d4adc-84e8-4646-897b-fe6332c575f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86d4adc-84e8-4646-897b-fe6332c575f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '087316ac-bda2-4929-9f22-25444af63a46', 'volume_name': 'volume-087316ac-bda2-4929-9f22-25444af63a46', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917b06b6-3f8c-4ab3-b42c-2fe4fee37e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917b06b6-3f8c-4ab3-b42c-2fe4fee37e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2803cd42-ee24-4ec7-912d-288212cfbfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:04 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Volume 087316ac-bda2-4929-9f22-25444af63a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-087316ac-bda2-4929-9f22-25444af63a46', 'volume_size': 1}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444" returned: 0 in 0.519s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881 2G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:04 devstack sudo[104126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881 2G
Aug 26 17:12:04 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:04 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881 2G" returned: 0 in 0.497s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd651938-3377-48c5-9f2b-3b841e08c444 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:04 devstack sudo[104132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd651938-3377-48c5-9f2b-3b841e08c444 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881
Aug 26 17:12:04 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:05 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd651938-3377-48c5-9f2b-3b841e08c444 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881" returned: 0 in 0.315s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:05 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881 is being set with open permissions: ugo+rw
Aug 26 17:12:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:05 devstack sudo[104137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881
Aug 26 17:12:05 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:05 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881" returned: 0 in 0.292s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:05 devstack sudo[104140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.info
Aug 26 17:12:05 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:05 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.info" returned: 0 in 0.288s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:05 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.info is being set with open permissions: ugo+rw
Aug 26 17:12:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:05 devstack sudo[104143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.info
Aug 26 17:12:05 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:06 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.info" returned: 0 in 0.324s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-948689704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087316ac-bda2-4929-9f22-25444af63a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efce5d1d3e4245a693133fd33303c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:04Z,use_quota=True,user_id='fb5cd4e7e46241faa86f9bc4514ae86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Creating volume 087316ac-bda2-4929-9f22-25444af63a46 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:12:06 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-087316ac-bda2-4929-9f22-25444af63a46 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:06 devstack sudo[104147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-087316ac-bda2-4929-9f22-25444af63a46 1073741824
Aug 26 17:12:06 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:06 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1acaf896-2747-41ec-9e78-34e35974bafb tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Create snapshot completed successfully
Aug 26 17:12:06 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-087316ac-bda2-4929-9f22-25444af63a46 1073741824" returned: 0 in 0.485s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-087316ac-bda2-4929-9f22-25444af63a46 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:06 devstack sudo[104153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-087316ac-bda2-4929-9f22-25444af63a46
Aug 26 17:12:06 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:06 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-087316ac-bda2-4929-9f22-25444af63a46" returned: 0 in 0.275s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2803cd42-ee24-4ec7-912d-288212cfbfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087316ac-bda2-4929-9f22-25444af63a46', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9907db72-6fbe-4be4-9990-b3ea6f9b4dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Acquiring lock "cinder-5610dce7-a8d0-4441-b91d-da487100e881-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:06 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Volume volume-087316ac-bda2-4929-9f22-25444af63a46 (087316ac-bda2-4929-9f22-25444af63a46): created successfully
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9907db72-6fbe-4be4-9990-b3ea6f9b4dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Flow 'volume_create_manager' (61498165-2ecd-4e9b-984f-9c7820f2d69f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "cinder-5610dce7-a8d0-4441-b91d-da487100e881-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Acquiring lock "cinder-quobyte-cd651938-3377-48c5-9f2b-3b841e08c444" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:07 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a0b3c700-7345-4797-989a-f38117b8fdf1 tempest-VolumeQuotasAdminTestJSON-147161724 None] Created volume successfully.
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "cinder-quobyte-cd651938-3377-48c5-9f2b-3b841e08c444" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Acquiring lock "cinder-quobyte-5610dce7-a8d0-4441-b91d-da487100e881" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "cinder-quobyte-5610dce7-a8d0-4441-b91d-da487100e881" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Deleting offline snapshot 5610dce7-a8d0-4441-b91d-da487100e881 of volume cd651938-3377-48c5-9f2b-3b841e08c444 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] snapshot_file for this snap is: volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[156d44ec-6174-44b7-849d-3440900b26d7]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:07 devstack sudo[104159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881
Aug 26 17:12:07 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:07 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881" returned: 0 in 0.469s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd651938-3377-48c5-9f2b-3b841e08c444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1426990-5e4f-4b99-b498-1fb7a87af3a9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:12:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:07 devstack sudo[104164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444
Aug 26 17:12:07 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:08 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444" returned: 0 in 0.453s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:08 devstack sudo[104169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881
Aug 26 17:12:08 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:08 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-be0d4071-f384-4b39-93f9-d97041b4b63d tempest-VolumeQuotasAdminTestJSON-1418492325 None] Transfer volume completed successfully.
Aug 26 17:12:08 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881" returned: 0 in 0.528s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:08 devstack sudo[104175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881
Aug 26 17:12:08 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:09 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444.5610dce7-a8d0-4441-b91d-da487100e881" returned: 0 in 0.402s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "cinder-quobyte-5610dce7-a8d0-4441-b91d-da487100e881" released by "_delete_snapshot" :: held 2.071s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "cinder-quobyte-cd651938-3377-48c5-9f2b-3b841e08c444" released by "delete_snapshot" :: held 2.120s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:09 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Created reservations ['58d39283-0740-43c1-8eed-02a2886d2450', '6fb870fc-943d-497e-af0f-9d4bbca32836', 'f38f9c6f-23ce-4d68-bbd7-183b94219e3a', 'cf6fd349-6565-471b-9d8d-557f802c63e3'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:12:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Acquiring lock "cinder-087316ac-bda2-4929-9f22-25444af63a46-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Lock "cinder-087316ac-bda2-4929-9f22-25444af63a46-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:09 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Delete snapshot completed successfully.
Aug 26 17:12:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0fc6cfcf-ba50-4404-81dd-16e26eac661a tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "cinder-5610dce7-a8d0-4441-b91d-da487100e881-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Acquiring lock "cinder-quobyte-087316ac-bda2-4929-9f22-25444af63a46" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Lock "cinder-quobyte-087316ac-bda2-4929-9f22-25444af63a46" acquired by "delete_volume" :: waited 0.033s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:09 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[339ff1e3-1f33-40f9-a3a8-ccb7f61876a0]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:12:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-087316ac-bda2-4929-9f22-25444af63a46 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:09 devstack sudo[104193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-087316ac-bda2-4929-9f22-25444af63a46
Aug 26 17:12:09 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:10 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-087316ac-bda2-4929-9f22-25444af63a46" returned: 0 in 0.547s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-087316ac-bda2-4929-9f22-25444af63a46 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:10 devstack sudo[104203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-087316ac-bda2-4929-9f22-25444af63a46
Aug 26 17:12:10 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Acquiring lock "cinder-cd651938-3377-48c5-9f2b-3b841e08c444-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "cinder-cd651938-3377-48c5-9f2b-3b841e08c444-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Acquiring lock "cinder-quobyte-cd651938-3377-48c5-9f2b-3b841e08c444" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "cinder-quobyte-cd651938-3377-48c5-9f2b-3b841e08c444" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:10 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-087316ac-bda2-4929-9f22-25444af63a46" returned: 0 in 0.395s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efef9db-23b0-4d5a-93f4-48b0275ce99d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Lock "cinder-quobyte-087316ac-bda2-4929-9f22-25444af63a46" released by "delete_volume" :: held 1.023s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Created reservations ['cd0372d4-8f5d-4086-8f75-fcc67444833c', '66b1e9a6-b9ae-4711-b836-b3d2b2c807bf', 'e803139b-7bdb-44ad-9f9f-cf1de1a59200', '6c2db326-8e00-48c4-9390-1a28bbd33b4e'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:12:10 devstack sudo[104206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444
Aug 26 17:12:10 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:10 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:12:10 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:11 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444" returned: 0 in 0.539s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:11 devstack sudo[104213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444
Aug 26 17:12:11 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:11 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.357s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:12:11 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Deleted volume successfully.
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d95d646-3434-4aca-a20a-16d91d4202f8 tempest-VolumeQuotasAdminTestJSON-1613544929 None] Lock "cinder-087316ac-bda2-4929-9f22-25444af63a46-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:11 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cd651938-3377-48c5-9f2b-3b841e08c444" returned: 0 in 0.358s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "cinder-quobyte-cd651938-3377-48c5-9f2b-3b841e08c444" released by "delete_volume" :: held 0.970s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Created reservations ['cc148789-d519-4356-9abf-3f077b7a316a', '47de8331-6ec7-4fea-a464-8799b23b2f34', 'ff24e161-037c-4858-bff7-8414dd4458d2', '474212d3-5f26-407c-a74f-2d8ed425a2b6'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:11 devstack sudo[104218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:12:11 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:11 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.375s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:11 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:12:11 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Deleted volume successfully.
Aug 26 17:12:12 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f0f81a32-5cc8-4a29-aa48-43acf5906be8 tempest-VolumesSnapshotNegativeTestJSON-1407233365 None] Lock "cinder-cd651938-3377-48c5-9f2b-3b841e08c444-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:21 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=36,cinder:UPDATE=38,cinder:INSERT=10,cinder:DELETE=4 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:12:21 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=42,cinder:INSERT=10,cinder:DELETE=3,cinder:SELECT=22 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Flow 'volume_create_manager' (94688fac-f88f-44bf-9773-516f3de9dd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46451b45-c854-41f3-b545-3ace14851113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46451b45-c854-41f3-b545-3ace14851113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1852535982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a8bada-9e9c-42c3-a201-39f1ed036cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95905d6c40142e4bd1f1822a230a4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:26Z,use_quota=True,user_id='613d6ced958b470ab8193167083bcdb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825aea7c-1fb3-483e-9564-68b25989f231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825aea7c-1fb3-483e-9564-68b25989f231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e110eb6-3dcc-41fa-9e71-a13b2aa0727f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e110eb6-3dcc-41fa-9e71-a13b2aa0727f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a8bada-9e9c-42c3-a201-39f1ed036cad', 'volume_name': 'volume-24a8bada-9e9c-42c3-a201-39f1ed036cad', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be24550b-9e7d-41db-b870-96b3e7b6a6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be24550b-9e7d-41db-b870-96b3e7b6a6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ee914c-0222-4351-a954-395544fec7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:25 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Volume 24a8bada-9e9c-42c3-a201-39f1ed036cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a8bada-9e9c-42c3-a201-39f1ed036cad', 'volume_size': 1}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1852535982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a8bada-9e9c-42c3-a201-39f1ed036cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95905d6c40142e4bd1f1822a230a4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:26Z,use_quota=True,user_id='613d6ced958b470ab8193167083bcdb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Creating volume 24a8bada-9e9c-42c3-a201-39f1ed036cad {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:12:25 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:12:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24a8bada-9e9c-42c3-a201-39f1ed036cad 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:25 devstack sudo[104344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24a8bada-9e9c-42c3-a201-39f1ed036cad 1073741824
Aug 26 17:12:25 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:26 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24a8bada-9e9c-42c3-a201-39f1ed036cad 1073741824" returned: 0 in 0.601s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24a8bada-9e9c-42c3-a201-39f1ed036cad {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:26 devstack sudo[104350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24a8bada-9e9c-42c3-a201-39f1ed036cad
Aug 26 17:12:26 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:27 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24a8bada-9e9c-42c3-a201-39f1ed036cad" returned: 0 in 0.514s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:12:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ee914c-0222-4351-a954-395544fec7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a8bada-9e9c-42c3-a201-39f1ed036cad', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6341b493-9008-4e6c-9427-780d6f06191a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:27 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Volume volume-24a8bada-9e9c-42c3-a201-39f1ed036cad (24a8bada-9e9c-42c3-a201-39f1ed036cad): created successfully
Aug 26 17:12:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6341b493-9008-4e6c-9427-780d6f06191a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Flow 'volume_create_manager' (94688fac-f88f-44bf-9773-516f3de9dd9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:27 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0c6c8fd7-477c-4672-ac5d-d05c9e32943c tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Created volume successfully.
Aug 26 17:12:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Acquiring lock "cinder-24a8bada-9e9c-42c3-a201-39f1ed036cad-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Lock "cinder-24a8bada-9e9c-42c3-a201-39f1ed036cad-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Acquiring lock "cinder-quobyte-24a8bada-9e9c-42c3-a201-39f1ed036cad" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Lock "cinder-quobyte-24a8bada-9e9c-42c3-a201-39f1ed036cad" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:29 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ea59c1-657b-4cfb-a5c2-d2fb26d4dc5e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:12:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24a8bada-9e9c-42c3-a201-39f1ed036cad {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:29 devstack sudo[104381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24a8bada-9e9c-42c3-a201-39f1ed036cad
Aug 26 17:12:29 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:29 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24a8bada-9e9c-42c3-a201-39f1ed036cad" returned: 0 in 0.402s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24a8bada-9e9c-42c3-a201-39f1ed036cad {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:29 devstack sudo[104386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24a8bada-9e9c-42c3-a201-39f1ed036cad
Aug 26 17:12:29 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:29 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-24a8bada-9e9c-42c3-a201-39f1ed036cad" returned: 0 in 0.293s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Lock "cinder-quobyte-24a8bada-9e9c-42c3-a201-39f1ed036cad" released by "delete_volume" :: held 0.738s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:30 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Created reservations ['3a905cfc-461a-4b20-9fc2-6fddafdeaadb', 'cb0e9631-6db4-4ea7-972c-480286796693', '2a2d3d3c-d462-4d38-b0b1-ea25db9c5087', '67344b72-f268-43b5-8672-41a98ffac205'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:12:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:30 devstack sudo[104389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:12:30 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:30 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.284s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:30 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:12:30 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Deleted volume successfully.
Aug 26 17:12:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-606ed470-8044-446b-8996-c2d3967fbf17 tempest-VolumeQuotasNegativeTestJSON-1306106973 None] Lock "cinder-24a8bada-9e9c-42c3-a201-39f1ed036cad-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:40 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=5,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:12:40 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=10,cinder:SELECT=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:42 devstack sudo[104399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:12:42 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:42 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.323s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Flow 'volume_create_manager' (e53708bd-4bd6-442d-89c4-91737098fc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7c3877-1c08-40c2-8e03-3367301f9581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 28 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7c3877-1c08-40c2-8e03-3367301f9581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-926454152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c114a4d-a4da-4c34-a881-0fab86636570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='706b6c9439874aa2b2a50089804c3519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:42Z,use_quota=True,user_id='8bf4e9c2b02043a892b4ec2267639942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3c3e465-69d0-49de-9665-56f7d9537ddb),volume_type_id=f3c3e465-69d0-49de-9665-56f7d9537ddb)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fe0a4b-6d93-4d1e-b553-e049b687ce1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fe0a4b-6d93-4d1e-b553-e049b687ce1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0df62f8-fdda-4765-92b3-727bf54036d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0df62f8-fdda-4765-92b3-727bf54036d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c114a4d-a4da-4c34-a881-0fab86636570', 'volume_name': 'volume-9c114a4d-a4da-4c34-a881-0fab86636570', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfdba69d-f418-46b5-b5f1-bb9bb0c90704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfdba69d-f418-46b5-b5f1-bb9bb0c90704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770086e1-f05b-4501-8d91-d898eb818295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:42 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Volume 9c114a4d-a4da-4c34-a881-0fab86636570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c114a4d-a4da-4c34-a881-0fab86636570', 'volume_size': 1}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-926454152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c114a4d-a4da-4c34-a881-0fab86636570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='706b6c9439874aa2b2a50089804c3519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:42Z,use_quota=True,user_id='8bf4e9c2b02043a892b4ec2267639942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3c3e465-69d0-49de-9665-56f7d9537ddb),volume_type_id=f3c3e465-69d0-49de-9665-56f7d9537ddb)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Creating volume 9c114a4d-a4da-4c34-a881-0fab86636570 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:12:42 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9c114a4d-a4da-4c34-a881-0fab86636570 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:42 devstack sudo[104402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9c114a4d-a4da-4c34-a881-0fab86636570 1073741824
Aug 26 17:12:42 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Flow 'volume_create_manager' (4ee0a93d-3899-4f5d-b9c1-bd7a265fa3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda3f9e2-8695-4f30-8489-57aa6f3ed7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda3f9e2-8695-4f30-8489-57aa6f3ed7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-415235452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff3d47e-08bb-43cc-a107-9b9c2ee9648d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56542fef448b460cb145f319b027b902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:42Z,use_quota=True,user_id='f93a8f4c3ef742f483512f64e9f5f84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70fb1b6-ed3c-4152-bcf0-f66f9a1c5097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70fb1b6-ed3c-4152-bcf0-f66f9a1c5097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe5df14-800c-479d-b06c-c4398f78feb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe5df14-800c-479d-b06c-c4398f78feb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff3d47e-08bb-43cc-a107-9b9c2ee9648d', 'volume_name': 'volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b619c3-7378-41ef-bfdf-3335d4d5d59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b619c3-7378-41ef-bfdf-3335d4d5d59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796f9905-ad55-4c77-81d7-d960f8b11c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:42 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Volume cff3d47e-08bb-43cc-a107-9b9c2ee9648d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d', 'volume_size': 1}
Aug 26 17:12:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:43 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9c114a4d-a4da-4c34-a881-0fab86636570 1073741824" returned: 0 in 0.685s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9c114a4d-a4da-4c34-a881-0fab86636570 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:43 devstack sudo[104408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9c114a4d-a4da-4c34-a881-0fab86636570
Aug 26 17:12:43 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:43 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9c114a4d-a4da-4c34-a881-0fab86636570" returned: 0 in 0.283s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-415235452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff3d47e-08bb-43cc-a107-9b9c2ee9648d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56542fef448b460cb145f319b027b902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:42Z,use_quota=True,user_id='f93a8f4c3ef742f483512f64e9f5f84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Creating volume cff3d47e-08bb-43cc-a107-9b9c2ee9648d {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:12:43 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770086e1-f05b-4501-8d91-d898eb818295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c114a4d-a4da-4c34-a881-0fab86636570', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:43 devstack sudo[104411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d 1073741824
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78923d7-5afa-4b69-8fb0-e8f70428879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:43 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:43 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Volume volume-9c114a4d-a4da-4c34-a881-0fab86636570 (9c114a4d-a4da-4c34-a881-0fab86636570): created successfully
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78923d7-5afa-4b69-8fb0-e8f70428879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Flow 'volume_create_manager' (e53708bd-4bd6-442d-89c4-91737098fc56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:43 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4078d54a-8c84-4b94-885a-2b772184ffac tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Created volume successfully.
Aug 26 17:12:44 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d 1073741824" returned: 0 in 0.564s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:44 devstack sudo[104417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d
Aug 26 17:12:44 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:44 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d" returned: 0 in 0.465s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796f9905-ad55-4c77-81d7-d960f8b11c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ae2927-8b08-4eff-a800-6e5574e755ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:44 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Volume volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d (cff3d47e-08bb-43cc-a107-9b9c2ee9648d): created successfully
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ae2927-8b08-4eff-a800-6e5574e755ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Flow 'volume_create_manager' (4ee0a93d-3899-4f5d-b9c1-bd7a265fa3db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-503fdc99-ddb2-48bb-8eb7-d55dda0f4f13 tempest-AttachVolumeNegativeTest-749108113 None] Created volume successfully.
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bf5e3401-23fc-4634-a7c5-e80e32d97b38 tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bf5e3401-23fc-4634-a7c5-e80e32d97b38 tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bf5e3401-23fc-4634-a7c5-e80e32d97b38 tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bf5e3401-23fc-4634-a7c5-e80e32d97b38 tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bf5e3401-23fc-4634-a7c5-e80e32d97b38 tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bf5e3401-23fc-4634-a7c5-e80e32d97b38 tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:44 devstack sudo[104420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:12:44 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:45 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bf5e3401-23fc-4634-a7c5-e80e32d97b38 tempest-VolumeRetypeWithoutMigrationTest-745488107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.377s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:45 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-bf5e3401-23fc-4634-a7c5-e80e32d97b38 tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:12:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-bf5e3401-23fc-4634-a7c5-e80e32d97b38 tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Retype volume completed successfully.
Aug 26 17:12:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Acquiring lock "cinder-9c114a4d-a4da-4c34-a881-0fab86636570-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Lock "cinder-9c114a4d-a4da-4c34-a881-0fab86636570-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Acquiring lock "cinder-quobyte-9c114a4d-a4da-4c34-a881-0fab86636570" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:12:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Lock "cinder-quobyte-9c114a4d-a4da-4c34-a881-0fab86636570" acquired by "delete_volume" :: waited 0.034s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:12:46 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a13632-2aa1-44d0-9382-7bb6f981fdb7]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:12:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9c114a4d-a4da-4c34-a881-0fab86636570 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:46 devstack sudo[104435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9c114a4d-a4da-4c34-a881-0fab86636570
Aug 26 17:12:46 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-a4330aef-9880-484a-ad49-fd867e2e0296 req-4d55b3c7-b969-4222-a0ac-a37b9eefe926 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-a4330aef-9880-484a-ad49-fd867e2e0296 req-4d55b3c7-b969-4222-a0ac-a37b9eefe926 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-a4330aef-9880-484a-ad49-fd867e2e0296 req-4d55b3c7-b969-4222-a0ac-a37b9eefe926 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-a4330aef-9880-484a-ad49-fd867e2e0296 req-4d55b3c7-b969-4222-a0ac-a37b9eefe926 tempest-AttachVolumeNegativeTest-749108113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9e73761-abb2-4238-88ca-4308e36273f4', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:12:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-a4330aef-9880-484a-ad49-fd867e2e0296 req-4d55b3c7-b969-4222-a0ac-a37b9eefe926 tempest-AttachVolumeNegativeTest-749108113 None] attachment_update completed successfully.
Aug 26 17:12:46 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9c114a4d-a4da-4c34-a881-0fab86636570" returned: 0 in 0.626s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9c114a4d-a4da-4c34-a881-0fab86636570 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:47 devstack sudo[104470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9c114a4d-a4da-4c34-a881-0fab86636570
Aug 26 17:12:47 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:47 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9c114a4d-a4da-4c34-a881-0fab86636570" returned: 0 in 0.415s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Lock "cinder-quobyte-9c114a4d-a4da-4c34-a881-0fab86636570" released by "delete_volume" :: held 1.145s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:47 devstack cinder-volume[94125]: WARNING cinder.quota [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:12:47 devstack cinder-volume[94125]: WARNING cinder.quota [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:12:47 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Created reservations ['9b97dd78-836d-40dd-bef8-60c27417a86e', 'a10244b3-9b94-495d-8ff5-8d9035d0fb5b', '6ca8cf5c-5e88-4dec-a04a-7a2062298fb9', 'fa765311-e224-4130-9221-1d320dc35eec'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:12:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:47 devstack sudo[104836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:12:47 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:48 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.323s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:48 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:12:48 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Deleted volume successfully.
Aug 26 17:12:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-99f951d8-54a8-47c4-873a-199c0c41a2cd tempest-VolumeRetypeWithoutMigrationTest-745488107 None] Lock "cinder-9c114a4d-a4da-4c34-a881-0fab86636570-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:12:50 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-7e15ebf6-155f-4d1b-b9c5-ea513545c911 req-fa79ee7e-f6de-44b5-a8cd-25a08466c938 tempest-AttachVolumeNegativeTest-749108113 None] Terminate volume connection completed successfully.
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-7e15ebf6-155f-4d1b-b9c5-ea513545c911 req-fa79ee7e-f6de-44b5-a8cd-25a08466c938 tempest-AttachVolumeNegativeTest-749108113 None] Deleting attachment c9e73761-abb2-4238-88ca-4308e36273f4. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Flow 'volume_create_manager' (5784832d-6922-443b-85ee-2cfb21ef4c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a778f92-91cc-47c7-99aa-d861f1d65b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a778f92-91cc-47c7-99aa-d861f1d65b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1364056663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086b1a9850a04514be6239cbac5c9c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:51Z,use_quota=True,user_id='c117e25687664a628b4663e0e123984f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca010e2-5dbf-4636-8a96-05bc441228c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca010e2-5dbf-4636-8a96-05bc441228c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22ada20-4855-4f00-86d1-667708f4d067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22ada20-4855-4f00-86d1-667708f4d067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec', 'volume_name': 'volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c36436f-5161-4149-90ec-87370d0f5b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c36436f-5161-4149-90ec-87370d0f5b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29bddefc-0d35-460b-a009-caadfcd3f530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:50 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Volume 9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec', 'volume_size': 1}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1364056663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086b1a9850a04514be6239cbac5c9c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:51Z,use_quota=True,user_id='c117e25687664a628b4663e0e123984f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Creating volume 9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:12:50 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:12:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:50 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec 1073741824
Aug 26 17:12:50 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Flow 'volume_create_manager' (bc82bb23-e4ab-4071-875c-bee4cbd59150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bcd7906-15cd-40f5-a060-545022e295ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bcd7906-15cd-40f5-a060-545022e295ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1014934810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84d3829-06cd-4583-b18c-d79fc67c3573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086b1a9850a04514be6239cbac5c9c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:51Z,use_quota=True,user_id='c117e25687664a628b4663e0e123984f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7be2bda-dcfd-4891-8e1b-75e4773a07c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:51 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7be2bda-dcfd-4891-8e1b-75e4773a07c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ef065d-961c-442c-aad6-7d8fc195539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ef065d-961c-442c-aad6-7d8fc195539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84d3829-06cd-4583-b18c-d79fc67c3573', 'volume_name': 'volume-e84d3829-06cd-4583-b18c-d79fc67c3573', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafe2057-f25b-436e-b32b-79bda92df81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafe2057-f25b-436e-b32b-79bda92df81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89022ff4-26be-498d-b257-035bb19002de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:51 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Volume e84d3829-06cd-4583-b18c-d79fc67c3573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84d3829-06cd-4583-b18c-d79fc67c3573', 'volume_size': 1}
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec 1073741824" returned: 0 in 0.807s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:51 devstack sudo[104882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec
Aug 26 17:12:51 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:52 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec" returned: 0 in 0.476s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1014934810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84d3829-06cd-4583-b18c-d79fc67c3573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086b1a9850a04514be6239cbac5c9c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:51Z,use_quota=True,user_id='c117e25687664a628b4663e0e123984f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Creating volume e84d3829-06cd-4583-b18c-d79fc67c3573 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:12:52 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e84d3829-06cd-4583-b18c-d79fc67c3573 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29bddefc-0d35-460b-a009-caadfcd3f530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c052fd46-21da-4be3-8d42-a0e59de02049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:52 devstack sudo[104900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e84d3829-06cd-4583-b18c-d79fc67c3573 1073741824
Aug 26 17:12:52 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:52 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Volume volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec (9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec): created successfully
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c052fd46-21da-4be3-8d42-a0e59de02049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Flow 'volume_create_manager' (5784832d-6922-443b-85ee-2cfb21ef4c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:52 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2df6ba07-5894-483c-b91a-4d83945e800c tempest-TestServerVolumeAttachmentScenario-13529333 None] Created volume successfully.
Aug 26 17:12:52 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e84d3829-06cd-4583-b18c-d79fc67c3573 1073741824" returned: 0 in 0.566s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e84d3829-06cd-4583-b18c-d79fc67c3573 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:52 devstack sudo[104906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e84d3829-06cd-4583-b18c-d79fc67c3573
Aug 26 17:12:52 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:12:53 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root
Aug 26 17:12:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e84d3829-06cd-4583-b18c-d79fc67c3573" returned: 0 in 0.289s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:12:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:12:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89022ff4-26be-498d-b257-035bb19002de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84d3829-06cd-4583-b18c-d79fc67c3573', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d6f88d-b90a-4dbb-a4c8-075893f8aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:53 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Volume volume-e84d3829-06cd-4583-b18c-d79fc67c3573 (e84d3829-06cd-4583-b18c-d79fc67c3573): created successfully
Aug 26 17:12:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d6f88d-b90a-4dbb-a4c8-075893f8aa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Flow 'volume_create_manager' (bc82bb23-e4ab-4071-875c-bee4cbd59150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:53 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-081e0442-1520-44d1-a360-c4a7459114ea tempest-TestServerVolumeAttachmentScenario-13529333 None] Created volume successfully.
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Flow 'volume_create_manager' (b1bac909-1039-48e7-b818-48f415a5702b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b626552-46dd-4ce9-a145-cf53baeddf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b626552-46dd-4ce9-a145-cf53baeddf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-159131472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254c3d83-3f1e-4ba2-bfe1-655378da64e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d89c3391a0d44139c3de5455b69b31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:59Z,use_quota=True,user_id='6485e8f444c94f97ad6ed2643dcce888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bb6fa7-820c-4c76-ab4e-615957bf2885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bb6fa7-820c-4c76-ab4e-615957bf2885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aab14bd-b101-4585-99be-0264dc988c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aab14bd-b101-4585-99be-0264dc988c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '254c3d83-3f1e-4ba2-bfe1-655378da64e0', 'volume_name': 'volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60def95f-6cd4-48e3-981d-242e0479cbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60def95f-6cd4-48e3-981d-242e0479cbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0851d5c3-bd75-49a7-98f5-3ff293353dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:12:59 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Volume 254c3d83-3f1e-4ba2-bfe1-655378da64e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0', 'volume_size': 1}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-159131472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254c3d83-3f1e-4ba2-bfe1-655378da64e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d89c3391a0d44139c3de5455b69b31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:12:59Z,use_quota=True,user_id='6485e8f444c94f97ad6ed2643dcce888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Creating volume 254c3d83-3f1e-4ba2-bfe1-655378da64e0 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:12:59 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:12:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:12:59 devstack sudo[104920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0 1073741824
Aug 26 17:12:59 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:00 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0 1073741824" returned: 0 in 0.639s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:00 devstack sudo[104926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0
Aug 26 17:13:00 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:00 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0" returned: 0 in 0.456s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:13:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0851d5c3-bd75-49a7-98f5-3ff293353dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2a2cfb-7390-4d89-9221-3bcae53c0ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:00 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Volume volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0 (254c3d83-3f1e-4ba2-bfe1-655378da64e0): created successfully
Aug 26 17:13:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2a2cfb-7390-4d89-9221-3bcae53c0ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Flow 'volume_create_manager' (b1bac909-1039-48e7-b818-48f415a5702b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:00 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-82904fa2-9699-4f83-8095-2e04befb6ae3 tempest-SnapshotMetadataTestJSON-1049608266 None] Created volume successfully.
Aug 26 17:13:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] Creating offline snapshot fb19853d-4505-45ae-a823-071d68a34ab9 of volume 254c3d83-3f1e-4ba2-bfe1-655378da64e0 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:13:01 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ddb0e0-edcd-497d-aa9b-053a5ecb89fb]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:13:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:01 devstack sudo[104962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0
Aug 26 17:13:01 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:02 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0" returned: 0 in 0.462s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:02 devstack sudo[104967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9 1G
Aug 26 17:13:02 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:02 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9 1G" returned: 0 in 0.482s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:02 devstack sudo[104973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9
Aug 26 17:13:02 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:03 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9" returned: 0 in 0.341s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:03 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9 is being set with open permissions: ugo+rw
Aug 26 17:13:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:03 devstack sudo[104978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9
Aug 26 17:13:03 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:03 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9" returned: 0 in 0.283s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:03 devstack sudo[104982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.info
Aug 26 17:13:03 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:03 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.info" returned: 0 in 0.351s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:03 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.info is being set with open permissions: ugo+rw
Aug 26 17:13:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:03 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.info
Aug 26 17:13:03 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:04 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.info" returned: 0 in 0.291s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.340s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:04 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-37c02d45-f30a-448e-9500-3b292f8c1a20 tempest-SnapshotMetadataTestJSON-1049608266 None] Create snapshot completed successfully
Aug 26 17:13:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Acquiring lock "cinder-fb19853d-4505-45ae-a823-071d68a34ab9-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "cinder-fb19853d-4505-45ae-a823-071d68a34ab9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Acquiring lock "cinder-quobyte-254c3d83-3f1e-4ba2-bfe1-655378da64e0" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "cinder-quobyte-254c3d83-3f1e-4ba2-bfe1-655378da64e0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Acquiring lock "cinder-quobyte-fb19853d-4505-45ae-a823-071d68a34ab9" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "cinder-quobyte-fb19853d-4505-45ae-a823-071d68a34ab9" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Deleting offline snapshot fb19853d-4505-45ae-a823-071d68a34ab9 of volume 254c3d83-3f1e-4ba2-bfe1-655378da64e0 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:13:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] snapshot_file for this snap is: volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:13:06 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[190691a4-3125-49e4-a105-c571320d7999]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:13:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:06 devstack sudo[105101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9
Aug 26 17:13:06 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:07 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9" returned: 0 in 0.953s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:13:07 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3f1ac5-1daf-403c-9469-d8da1d4eeffc]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:13:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:07 devstack sudo[105157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0
Aug 26 17:13:07 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:08 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0" returned: 0 in 0.510s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:08 devstack sudo[105171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9
Aug 26 17:13:08 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:08 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9" returned: 0 in 0.801s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:09 devstack sudo[105185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9
Aug 26 17:13:09 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:09 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0.fb19853d-4505-45ae-a823-071d68a34ab9" returned: 0 in 0.838s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "cinder-quobyte-fb19853d-4505-45ae-a823-071d68a34ab9" released by "_delete_snapshot" :: held 3.408s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "cinder-quobyte-254c3d83-3f1e-4ba2-bfe1-655378da64e0" released by "delete_snapshot" :: held 3.473s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:10 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Created reservations ['b7d0eb50-bc5f-4cac-806a-55377a786832', '0c79cca2-7738-4eba-8677-924c777990fb', '06919d6b-4a99-40b9-8401-8796069c4cc6', '74c1287a-2626-4cec-8b6e-da69f460c0e5'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:13:10 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Delete snapshot completed successfully.
Aug 26 17:13:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-fb0b3faa-7b9c-4706-95ad-407111a17a32 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "cinder-fb19853d-4505-45ae-a823-071d68a34ab9-delete_snapshot" released by "delete_snapshot" :: held 3.881s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Acquiring lock "cinder-254c3d83-3f1e-4ba2-bfe1-655378da64e0-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "cinder-254c3d83-3f1e-4ba2-bfe1-655378da64e0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Acquiring lock "cinder-quobyte-254c3d83-3f1e-4ba2-bfe1-655378da64e0" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "cinder-quobyte-254c3d83-3f1e-4ba2-bfe1-655378da64e0" acquired by "delete_volume" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:11 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f13311-6c8b-4a79-85c5-0890e829ffd7]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:13:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:11 devstack sudo[105190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0
Aug 26 17:13:11 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:12 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0" returned: 0 in 0.973s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:12 devstack sudo[105197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0
Aug 26 17:13:12 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:12 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-254c3d83-3f1e-4ba2-bfe1-655378da64e0" returned: 0 in 0.518s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:12 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "cinder-quobyte-254c3d83-3f1e-4ba2-bfe1-655378da64e0" released by "delete_volume" :: held 1.651s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:13 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Created reservations ['0db8aa7f-388f-4126-b70e-fda0971748b4', 'a3527f6c-1b3f-4de0-8548-1624a79235f4', '4528b4cf-f3f1-4a18-a43b-a0fedbd39be0', '02c95782-9a03-42f8-9595-9254eb0ce3ad'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:13:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:13 devstack sudo[105201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:13:13 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:13 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:13:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Flow 'volume_create_manager' (d0fc5fb0-50b9-4731-850f-cf23cab35ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b280270-7a6d-41fe-836c-6c6a4ef1c1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b280270-7a6d-41fe-836c-6c6a4ef1c1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-211644111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419e134d-dfc8-453e-a0af-2de24a430b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e91a0c97ac84191a60dcbd05912e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:14Z,use_quota=True,user_id='da9e37037dfd4c459a3bb8a051353256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ffe4ab-e60c-4af7-8c05-fedce483e6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ffe4ab-e60c-4af7-8c05-fedce483e6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8a1ac7-5f3a-4a62-b28f-da49763f0e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8a1ac7-5f3a-4a62-b28f-da49763f0e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419e134d-dfc8-453e-a0af-2de24a430b21', 'volume_name': 'volume-419e134d-dfc8-453e-a0af-2de24a430b21', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a40270b-353b-403e-83fd-c00bdbf149ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:14 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a40270b-353b-403e-83fd-c00bdbf149ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46eed90-52a7-4a52-9c88-22405872e664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:14 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Volume 419e134d-dfc8-453e-a0af-2de24a430b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419e134d-dfc8-453e-a0af-2de24a430b21', 'volume_size': 1}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-211644111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419e134d-dfc8-453e-a0af-2de24a430b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e91a0c97ac84191a60dcbd05912e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:14Z,use_quota=True,user_id='da9e37037dfd4c459a3bb8a051353256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Creating volume 419e134d-dfc8-453e-a0af-2de24a430b21 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:13:14 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-419e134d-dfc8-453e-a0af-2de24a430b21 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 1.248s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:13:14 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Deleted volume successfully.
Aug 26 17:13:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-39cf576c-a451-4ed0-a899-15b710a78832 tempest-SnapshotMetadataTestJSON-1049608266 None] Lock "cinder-254c3d83-3f1e-4ba2-bfe1-655378da64e0-delete_volume" released by "delete_volume" :: held 3.469s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:14 devstack sudo[105270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-419e134d-dfc8-453e-a0af-2de24a430b21 1073741824
Aug 26 17:13:14 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:16 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-419e134d-dfc8-453e-a0af-2de24a430b21 1073741824" returned: 0 in 2.048s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-419e134d-dfc8-453e-a0af-2de24a430b21 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:16 devstack sudo[105315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-419e134d-dfc8-453e-a0af-2de24a430b21
Aug 26 17:13:16 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:17 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-419e134d-dfc8-453e-a0af-2de24a430b21" returned: 0 in 0.500s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] <== create_volume: return (2730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:13:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.736s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46eed90-52a7-4a52-9c88-22405872e664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419e134d-dfc8-453e-a0af-2de24a430b21', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5cc53d-e33f-441b-a919-90ed3995628b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:17 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Volume volume-419e134d-dfc8-453e-a0af-2de24a430b21 (419e134d-dfc8-453e-a0af-2de24a430b21): created successfully
Aug 26 17:13:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5cc53d-e33f-441b-a919-90ed3995628b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:17 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Flow 'volume_create_manager' (d0fc5fb0-50b9-4731-850f-cf23cab35ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:17 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e17e987d-eeb6-4ee3-8e36-a0ced662e436 tempest-VolumesActionsTest-1938654129 None] Created volume successfully.
Aug 26 17:13:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6aa9fd0b-ce96-45ca-b9db-34ae7ba4ee8f tempest-VolumesActionsTest-1938654129 None] Acquiring lock "cinder-419e134d-dfc8-453e-a0af-2de24a430b21" by "attach_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6aa9fd0b-ce96-45ca-b9db-34ae7ba4ee8f tempest-VolumesActionsTest-1938654129 None] Lock "cinder-419e134d-dfc8-453e-a0af-2de24a430b21" acquired by "attach_volume" :: waited 0.037s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:18 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6aa9fd0b-ce96-45ca-b9db-34ae7ba4ee8f tempest-VolumesActionsTest-1938654129 None] Attaching volume 419e134d-dfc8-453e-a0af-2de24a430b21 to instance 6a6b70b8-5d7a-46e1-b4ad-b0b2f8bfaa26 at mountpoint /dev/vdb on host None.
Aug 26 17:13:18 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6aa9fd0b-ce96-45ca-b9db-34ae7ba4ee8f tempest-VolumesActionsTest-1938654129 None] Attach volume completed successfully.
Aug 26 17:13:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6aa9fd0b-ce96-45ca-b9db-34ae7ba4ee8f tempest-VolumesActionsTest-1938654129 None] Lock "cinder-419e134d-dfc8-453e-a0af-2de24a430b21" released by "attach_volume" :: held 0.176s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6023a42d-0e36-4742-ba00-7680b08608df tempest-VolumesActionsTest-480769294 None] Terminate volume connection completed successfully.
Aug 26 17:13:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6023a42d-0e36-4742-ba00-7680b08608df tempest-VolumesActionsTest-480769294 None] Acquiring lock "cinder-419e134d-dfc8-453e-a0af-2de24a430b21-detach_volume" by "detach_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6023a42d-0e36-4742-ba00-7680b08608df tempest-VolumesActionsTest-480769294 None] Lock "cinder-419e134d-dfc8-453e-a0af-2de24a430b21-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6023a42d-0e36-4742-ba00-7680b08608df tempest-VolumesActionsTest-480769294 None] Detaching volume 419e134d-dfc8-453e-a0af-2de24a430b21 from instance 6a6b70b8-5d7a-46e1-b4ad-b0b2f8bfaa26.
Aug 26 17:13:20 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6023a42d-0e36-4742-ba00-7680b08608df tempest-VolumesActionsTest-480769294 None] Detach volume completed successfully.
Aug 26 17:13:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6023a42d-0e36-4742-ba00-7680b08608df tempest-VolumesActionsTest-480769294 None] Lock "cinder-419e134d-dfc8-453e-a0af-2de24a430b21-detach_volume" released by "detach_volume" :: held 0.094s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-03839d83-9421-41c1-bd16-6aba5765c255 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "cinder-419e134d-dfc8-453e-a0af-2de24a430b21-detach_volume" by "detach_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-03839d83-9421-41c1-bd16-6aba5765c255 tempest-VolumesActionsTest-1938654129 None] Lock "cinder-419e134d-dfc8-453e-a0af-2de24a430b21-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:20 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-03839d83-9421-41c1-bd16-6aba5765c255 tempest-VolumesActionsTest-1938654129 None] Volume detach called, but volume not attached.
Aug 26 17:13:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-03839d83-9421-41c1-bd16-6aba5765c255 tempest-VolumesActionsTest-1938654129 None] Lock "cinder-419e134d-dfc8-453e-a0af-2de24a430b21-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "cinder-419e134d-dfc8-453e-a0af-2de24a430b21-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Lock "cinder-419e134d-dfc8-453e-a0af-2de24a430b21-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "cinder-quobyte-419e134d-dfc8-453e-a0af-2de24a430b21" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Lock "cinder-quobyte-419e134d-dfc8-453e-a0af-2de24a430b21" acquired by "delete_volume" :: waited 0.051s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:21 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[8613378a-82da-4be2-89bb-39a6011153cc]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:13:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-419e134d-dfc8-453e-a0af-2de24a430b21 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:21 devstack sudo[105334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-419e134d-dfc8-453e-a0af-2de24a430b21
Aug 26 17:13:21 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:22 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-419e134d-dfc8-453e-a0af-2de24a430b21" returned: 0 in 0.805s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-419e134d-dfc8-453e-a0af-2de24a430b21 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:22 devstack sudo[105339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-419e134d-dfc8-453e-a0af-2de24a430b21
Aug 26 17:13:22 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:22 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-419e134d-dfc8-453e-a0af-2de24a430b21" returned: 0 in 0.656s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Lock "cinder-quobyte-419e134d-dfc8-453e-a0af-2de24a430b21" released by "delete_volume" :: held 1.559s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:22 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Created reservations ['f23b2763-aa0b-444b-95c2-3609e8251444', '3028e450-78f4-427f-bd46-4754feda545a', '4da7e620-da09-4d44-937d-cc3e33acb277', '56cbc1b2-20b0-4c45-b2fa-e8aae517438d'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:13:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:23 devstack sudo[105343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:13:23 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:23 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.739s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:23 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:13:23 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Deleted volume successfully.
Aug 26 17:13:23 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c46c576a-8785-4d93-88c2-ab9f1238b0e4 tempest-VolumesActionsTest-1938654129 None] Lock "cinder-419e134d-dfc8-453e-a0af-2de24a430b21-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Flow 'volume_create_manager' (68d4aea1-213a-4da7-8922-8170f9e4e81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fac9cb0-acee-4616-87a7-b6aaa3efc701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fac9cb0-acee-4616-87a7-b6aaa3efc701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1913576875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a5f253-369a-4dc4-888c-82927c264646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e91a0c97ac84191a60dcbd05912e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:28Z,use_quota=True,user_id='da9e37037dfd4c459a3bb8a051353256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c44ef7-1c1e-4875-ac56-648d5880bbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c44ef7-1c1e-4875-ac56-648d5880bbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4068ff-28ed-41f8-b224-1b074b9d88b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4068ff-28ed-41f8-b224-1b074b9d88b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a5f253-369a-4dc4-888c-82927c264646', 'volume_name': 'volume-27a5f253-369a-4dc4-888c-82927c264646', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f9df1d-42a2-45f9-90ac-58fcd9036700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f9df1d-42a2-45f9-90ac-58fcd9036700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c1ecb2-fc71-42da-9846-b76e85361921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:27 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Volume 27a5f253-369a-4dc4-888c-82927c264646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a5f253-369a-4dc4-888c-82927c264646', 'volume_size': 1}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1913576875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a5f253-369a-4dc4-888c-82927c264646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e91a0c97ac84191a60dcbd05912e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:28Z,use_quota=True,user_id='da9e37037dfd4c459a3bb8a051353256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Creating volume 27a5f253-369a-4dc4-888c-82927c264646 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:13:27 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:13:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27a5f253-369a-4dc4-888c-82927c264646 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:27 devstack sudo[105427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27a5f253-369a-4dc4-888c-82927c264646 1073741824
Aug 26 17:13:27 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Flow 'volume_create_manager' (6485fc04-3bfd-44ce-b411-45ce82394c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906a92f6-93c0-4090-811c-ff3b8a87e12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906a92f6-93c0-4090-811c-ff3b8a87e12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1987486447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e47b17-66d1-4ccf-83c7-dce551fc546d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4de4aebada104a8ba496fd0a9bc3076e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:28Z,use_quota=True,user_id='581db8fff0a84bf2bb2096689c5b2bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b4b8dd-057c-4334-a2f7-f9d8819ec083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b4b8dd-057c-4334-a2f7-f9d8819ec083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:28 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b17a8fb-88ec-4eb2-9da8-58ef1a36c66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b17a8fb-88ec-4eb2-9da8-58ef1a36c66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e47b17-66d1-4ccf-83c7-dce551fc546d', 'volume_name': 'volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48b2640-c848-4e81-820c-f34115398d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48b2640-c848-4e81-820c-f34115398d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8248ba9-5fa9-4019-baad-b38be6684d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:28 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Volume f4e47b17-66d1-4ccf-83c7-dce551fc546d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d', 'volume_size': 1}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27a5f253-369a-4dc4-888c-82927c264646 1073741824" returned: 0 in 0.588s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27a5f253-369a-4dc4-888c-82927c264646 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:28 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27a5f253-369a-4dc4-888c-82927c264646
Aug 26 17:13:28 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:28 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27a5f253-369a-4dc4-888c-82927c264646" returned: 0 in 0.255s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.298s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1987486447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e47b17-66d1-4ccf-83c7-dce551fc546d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4de4aebada104a8ba496fd0a9bc3076e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:28Z,use_quota=True,user_id='581db8fff0a84bf2bb2096689c5b2bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Creating volume f4e47b17-66d1-4ccf-83c7-dce551fc546d {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:13:28 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c1ecb2-fc71-42da-9846-b76e85361921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a5f253-369a-4dc4-888c-82927c264646', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:28 devstack sudo[105436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d 1073741824
Aug 26 17:13:28 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e183db-75a1-4979-ad15-2951c0f96b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:28 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Volume volume-27a5f253-369a-4dc4-888c-82927c264646 (27a5f253-369a-4dc4-888c-82927c264646): created successfully
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e183db-75a1-4979-ad15-2951c0f96b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Flow 'volume_create_manager' (68d4aea1-213a-4da7-8922-8170f9e4e81f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:28 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0c3aa5ad-bb10-4601-a87e-2c94d7431462 tempest-VolumesActionsTest-1938654129 None] Created volume successfully.
Aug 26 17:13:29 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d 1073741824" returned: 0 in 0.411s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:29 devstack sudo[105442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d
Aug 26 17:13:29 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:29 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d" returned: 0 in 0.274s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:13:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8248ba9-5fa9-4019-baad-b38be6684d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51c5d95-08d0-45eb-b554-bd05e75daabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:29 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Volume volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d (f4e47b17-66d1-4ccf-83c7-dce551fc546d): created successfully
Aug 26 17:13:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51c5d95-08d0-45eb-b554-bd05e75daabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Flow 'volume_create_manager' (6485fc04-3bfd-44ce-b411-45ce82394c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-94c5b264-38d7-49ac-b158-71a2cca68a55 tempest-VolumesTransfersTest-1780781840 None] Created volume successfully.
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Acquiring lock "cinder-27a5f253-369a-4dc4-888c-82927c264646-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Lock "cinder-27a5f253-369a-4dc4-888c-82927c264646-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Acquiring lock "cinder-quobyte-27a5f253-369a-4dc4-888c-82927c264646" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Lock "cinder-quobyte-27a5f253-369a-4dc4-888c-82927c264646" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[398fb4ae-e5fb-4b79-b618-fd8130b5a78a]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27a5f253-369a-4dc4-888c-82927c264646 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:30 devstack sudo[105445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27a5f253-369a-4dc4-888c-82927c264646
Aug 26 17:13:30 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:30 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27a5f253-369a-4dc4-888c-82927c264646" returned: 0 in 0.383s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27a5f253-369a-4dc4-888c-82927c264646 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:30 devstack sudo[105450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27a5f253-369a-4dc4-888c-82927c264646
Aug 26 17:13:30 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:30 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-27a5f253-369a-4dc4-888c-82927c264646" returned: 0 in 0.280s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Lock "cinder-quobyte-27a5f253-369a-4dc4-888c-82927c264646" released by "delete_volume" :: held 0.710s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Created reservations ['228a3450-8dd7-4fe0-8a55-f51a0cb524eb', 'd989d27c-6455-4676-9035-7a521b9a47f2', '09d66c30-9b84-43b2-b921-43ebc1a1e067', '2d817df9-4bc6-4544-8e2d-b871f4e9563c'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:31 devstack sudo[105453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:13:31 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:31 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-bbb74f95-90ee-4585-9c5a-ea09213ee67d tempest-VolumesTransfersTest-1309972387 None] Transfer volume completed successfully.
Aug 26 17:13:31 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.318s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:13:31 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Deleted volume successfully.
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f45de7cf-6986-4a6f-bf8e-024c64a88025 tempest-VolumesActionsTest-480769294 None] Lock "cinder-27a5f253-369a-4dc4-888c-82927c264646-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Acquiring lock "cinder-f4e47b17-66d1-4ccf-83c7-dce551fc546d-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Lock "cinder-f4e47b17-66d1-4ccf-83c7-dce551fc546d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Acquiring lock "cinder-quobyte-f4e47b17-66d1-4ccf-83c7-dce551fc546d" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Lock "cinder-quobyte-f4e47b17-66d1-4ccf-83c7-dce551fc546d" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c6c8ce-bb9e-4fe5-886d-cf1040d498f1]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Flow 'volume_create_manager' (342d8838-a69c-4cff-bd8b-b380a7597007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81614fda-2a1f-477e-a432-22e3fc54aace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:31 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d
Aug 26 17:13:32 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81614fda-2a1f-477e-a432-22e3fc54aace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1379299962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa43a1c6-b75f-413e-88e4-f7e37a67432e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e91a0c97ac84191a60dcbd05912e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:32Z,use_quota=True,user_id='da9e37037dfd4c459a3bb8a051353256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80cc3dfe-7fa1-483f-a1eb-c3da5d473adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80cc3dfe-7fa1-483f-a1eb-c3da5d473adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253974c6-f9e1-4147-b2b4-73994450f408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253974c6-f9e1-4147-b2b4-73994450f408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa43a1c6-b75f-413e-88e4-f7e37a67432e', 'volume_name': 'volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2beb3039-8d27-4f04-a312-6bc70b725710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2beb3039-8d27-4f04-a312-6bc70b725710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bdd67a4-f975-475e-98e1-d68d8ca71d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:32 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Volume fa43a1c6-b75f-413e-88e4-f7e37a67432e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e', 'volume_size': 1}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1379299962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa43a1c6-b75f-413e-88e4-f7e37a67432e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e91a0c97ac84191a60dcbd05912e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:32Z,use_quota=True,user_id='da9e37037dfd4c459a3bb8a051353256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Creating volume fa43a1c6-b75f-413e-88e4-f7e37a67432e {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:13:32 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:32 devstack sudo[105458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e 1073741824
Aug 26 17:13:32 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:32 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d" returned: 0 in 0.386s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:32 devstack sudo[105464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d
Aug 26 17:13:32 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:32 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e 1073741824" returned: 0 in 0.434s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:32 devstack sudo[105470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e
Aug 26 17:13:32 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:32 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f4e47b17-66d1-4ccf-83c7-dce551fc546d" returned: 0 in 0.313s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Lock "cinder-quobyte-f4e47b17-66d1-4ccf-83c7-dce551fc546d" released by "delete_volume" :: held 0.747s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Created reservations ['6ebfee12-cc4a-482a-ae23-e7fb91504737', 'cdd83277-5163-4f9c-9567-ee58f7373113', '00e4b22d-341b-4379-a843-49c5c9242742', 'b4642f53-72a7-43eb-be43-2d62aa77772c'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:32 devstack sudo[105472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:13:32 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:32 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e" returned: 0 in 0.273s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bdd67a4-f975-475e-98e1-d68d8ca71d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7d3d77-07e4-49eb-bcff-80f8c3d7e819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:32 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Volume volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e (fa43a1c6-b75f-413e-88e4-f7e37a67432e): created successfully
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7d3d77-07e4-49eb-bcff-80f8c3d7e819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Flow 'volume_create_manager' (342d8838-a69c-4cff-bd8b-b380a7597007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:32 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-407fe6a5-d2da-4e28-87b9-4181d37a3e76 tempest-VolumesActionsTest-1938654129 None] Created volume successfully.
Aug 26 17:13:33 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.362s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:13:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Deleted volume successfully.
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-86a6aad3-711f-441d-a315-f348cad78d14 tempest-VolumesTransfersTest-810737689 None] Lock "cinder-f4e47b17-66d1-4ccf-83c7-dce551fc546d-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Flow 'volume_create_manager' (8e887c8e-6dee-4101-98a4-61e6e579522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ad8b95-c646-4649-a897-6e6b7d6b992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ad8b95-c646-4649-a897-6e6b7d6b992c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-187969316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62ef763-a024-491d-a250-a65d656e4ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4de4aebada104a8ba496fd0a9bc3076e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:34Z,use_quota=True,user_id='581db8fff0a84bf2bb2096689c5b2bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98785d4-c81f-455f-84a4-558981d722e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98785d4-c81f-455f-84a4-558981d722e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ae2bc9-1b54-42e5-874f-cd6bf23c104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ae2bc9-1b54-42e5-874f-cd6bf23c104b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a62ef763-a024-491d-a250-a65d656e4ad6', 'volume_name': 'volume-a62ef763-a024-491d-a250-a65d656e4ad6', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42eda10a-56a7-4fed-9865-2d222058c1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42eda10a-56a7-4fed-9865-2d222058c1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b15a690-7461-471d-bf66-d133689ff26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:33 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Volume a62ef763-a024-491d-a250-a65d656e4ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a62ef763-a024-491d-a250-a65d656e4ad6', 'volume_size': 1}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-187969316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62ef763-a024-491d-a250-a65d656e4ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4de4aebada104a8ba496fd0a9bc3076e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:34Z,use_quota=True,user_id='581db8fff0a84bf2bb2096689c5b2bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Creating volume a62ef763-a024-491d-a250-a65d656e4ad6 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:13:33 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:13:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a62ef763-a024-491d-a250-a65d656e4ad6 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:33 devstack sudo[105484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a62ef763-a024-491d-a250-a65d656e4ad6 1073741824
Aug 26 17:13:33 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Acquiring lock "cinder-fa43a1c6-b75f-413e-88e4-f7e37a67432e-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Lock "cinder-fa43a1c6-b75f-413e-88e4-f7e37a67432e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:34 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a62ef763-a024-491d-a250-a65d656e4ad6 1073741824" returned: 0 in 0.537s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Acquiring lock "cinder-quobyte-fa43a1c6-b75f-413e-88e4-f7e37a67432e" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Lock "cinder-quobyte-fa43a1c6-b75f-413e-88e4-f7e37a67432e" acquired by "delete_volume" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a62ef763-a024-491d-a250-a65d656e4ad6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03efd43-3101-4bb9-8182-00665c67977a]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:34 devstack sudo[105504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a62ef763-a024-491d-a250-a65d656e4ad6
Aug 26 17:13:34 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:34 devstack sudo[105505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e
Aug 26 17:13:34 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:34 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a62ef763-a024-491d-a250-a65d656e4ad6" returned: 0 in 0.268s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b15a690-7461-471d-bf66-d133689ff26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62ef763-a024-491d-a250-a65d656e4ad6', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e96a3ad-4aee-49cb-a47b-81a63258fe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:34 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Volume volume-a62ef763-a024-491d-a250-a65d656e4ad6 (a62ef763-a024-491d-a250-a65d656e4ad6): created successfully
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e96a3ad-4aee-49cb-a47b-81a63258fe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Flow 'volume_create_manager' (8e887c8e-6dee-4101-98a4-61e6e579522f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:34 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-fde36ac3-fc33-4aa2-a206-7390595c44bc tempest-VolumesTransfersTest-1780781840 None] Created volume successfully.
Aug 26 17:13:34 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e" returned: 0 in 0.420s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:34 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e
Aug 26 17:13:34 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:35 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa43a1c6-b75f-413e-88e4-f7e37a67432e" returned: 0 in 0.255s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Lock "cinder-quobyte-fa43a1c6-b75f-413e-88e4-f7e37a67432e" released by "delete_volume" :: held 0.725s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Created reservations ['1c489b5a-655e-4754-9d38-27ea9c3ade85', 'ee6d311c-fb38-4530-96e1-848ef2b8df1d', '9265bc0e-e089-476b-92e8-58966d958627', '033bd510-4fe0-47c6-aa24-d502a05041f6'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:35 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:13:35 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:35 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.286s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:13:35 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Deleted volume successfully.
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-efd95cb1-8642-4802-b479-5d8578f72a49 tempest-VolumesActionsTest-480769294 None] Lock "cinder-fa43a1c6-b75f-413e-88e4-f7e37a67432e-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Flow 'volume_create_manager' (0b4a081b-12db-46b6-9dd4-8fcbd1f82f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4fe8cb-0596-4c09-bd38-8ee941850b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4fe8cb-0596-4c09-bd38-8ee941850b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-959692142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bb73c2-85ee-4985-850c-d51572de66e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e91a0c97ac84191a60dcbd05912e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:36Z,use_quota=True,user_id='da9e37037dfd4c459a3bb8a051353256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb43c43-8463-4838-b5ae-0fc66e8084db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb43c43-8463-4838-b5ae-0fc66e8084db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129e554b-f2aa-43ac-936b-ced8f31ce667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129e554b-f2aa-43ac-936b-ced8f31ce667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62bb73c2-85ee-4985-850c-d51572de66e2', 'volume_name': 'volume-62bb73c2-85ee-4985-850c-d51572de66e2', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a816f463-28a7-4b30-8cec-d3d644469728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a816f463-28a7-4b30-8cec-d3d644469728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2346293b-0d27-4a56-8c9d-0b0fc29f9eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:36 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Volume 62bb73c2-85ee-4985-850c-d51572de66e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62bb73c2-85ee-4985-850c-d51572de66e2', 'volume_size': 1}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-959692142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bb73c2-85ee-4985-850c-d51572de66e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e91a0c97ac84191a60dcbd05912e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:36Z,use_quota=True,user_id='da9e37037dfd4c459a3bb8a051353256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Creating volume 62bb73c2-85ee-4985-850c-d51572de66e2 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:13:36 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62bb73c2-85ee-4985-850c-d51572de66e2 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:36 devstack sudo[105522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62bb73c2-85ee-4985-850c-d51572de66e2 1073741824
Aug 26 17:13:36 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Acquiring lock "cinder-a62ef763-a024-491d-a250-a65d656e4ad6-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Lock "cinder-a62ef763-a024-491d-a250-a65d656e4ad6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Acquiring lock "cinder-quobyte-a62ef763-a024-491d-a250-a65d656e4ad6" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Lock "cinder-quobyte-a62ef763-a024-491d-a250-a65d656e4ad6" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4386371a-9194-43b2-88fc-8f2e4b6063a1]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a62ef763-a024-491d-a250-a65d656e4ad6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:36 devstack sudo[105524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a62ef763-a024-491d-a250-a65d656e4ad6
Aug 26 17:13:36 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:36 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62bb73c2-85ee-4985-850c-d51572de66e2 1073741824" returned: 0 in 0.551s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:36 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a62ef763-a024-491d-a250-a65d656e4ad6" returned: 0 in 0.408s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a62ef763-a024-491d-a250-a65d656e4ad6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62bb73c2-85ee-4985-850c-d51572de66e2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:36 devstack sudo[105535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a62ef763-a024-491d-a250-a65d656e4ad6
Aug 26 17:13:36 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:36 devstack sudo[105537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62bb73c2-85ee-4985-850c-d51572de66e2
Aug 26 17:13:36 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:36 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a62ef763-a024-491d-a250-a65d656e4ad6" returned: 0 in 0.307s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Lock "cinder-quobyte-a62ef763-a024-491d-a250-a65d656e4ad6" released by "delete_volume" :: held 0.767s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:37 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62bb73c2-85ee-4985-850c-d51572de66e2" returned: 0 in 0.346s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2346293b-0d27-4a56-8c9d-0b0fc29f9eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62bb73c2-85ee-4985-850c-d51572de66e2', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194ac236-3fbc-463b-8655-b240a60f1552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Created reservations ['bbfd7e63-6448-4454-b62c-afad4d8c25a1', 'dc7bd9ed-255c-4d03-a754-5512d304be5d', '9125905a-e746-49b2-93c9-ef571df03bc8', 'e8f6adee-7695-4930-9a0e-46688e21b845'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:13:37 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Volume volume-62bb73c2-85ee-4985-850c-d51572de66e2 (62bb73c2-85ee-4985-850c-d51572de66e2): created successfully
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194ac236-3fbc-463b-8655-b240a60f1552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Flow 'volume_create_manager' (0b4a081b-12db-46b6-9dd4-8fcbd1f82f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-43710879-0905-4a35-91d0-62e1093a9e57 tempest-VolumesActionsTest-1938654129 None] Created volume successfully.
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:37 devstack sudo[105549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:13:37 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-1c1ce024-486d-4428-b39d-e296d4f56923 req-d46317a5-3efa-435f-8ca5-a54e46001a4e tempest-TestServerVolumeAttachmentScenario-13529333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-1c1ce024-486d-4428-b39d-e296d4f56923 req-d46317a5-3efa-435f-8ca5-a54e46001a4e tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-1c1ce024-486d-4428-b39d-e296d4f56923 req-d46317a5-3efa-435f-8ca5-a54e46001a4e tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-1c1ce024-486d-4428-b39d-e296d4f56923 req-d46317a5-3efa-435f-8ca5-a54e46001a4e tempest-TestServerVolumeAttachmentScenario-13529333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a042006-bb3e-44e2-a3ed-ab38ccf2ffae', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:13:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-1c1ce024-486d-4428-b39d-e296d4f56923 req-d46317a5-3efa-435f-8ca5-a54e46001a4e tempest-TestServerVolumeAttachmentScenario-13529333 None] attachment_update completed successfully.
Aug 26 17:13:37 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.267s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:13:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Deleted volume successfully.
Aug 26 17:13:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cf79dea5-ed8c-4528-ae6e-18c20ee80f7e tempest-VolumesTransfersTest-810737689 None] Lock "cinder-a62ef763-a024-491d-a250-a65d656e4ad6-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Acquiring lock "cinder-62bb73c2-85ee-4985-850c-d51572de66e2-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Lock "cinder-62bb73c2-85ee-4985-850c-d51572de66e2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Acquiring lock "cinder-quobyte-62bb73c2-85ee-4985-850c-d51572de66e2" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Lock "cinder-quobyte-62bb73c2-85ee-4985-850c-d51572de66e2" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:38 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a1f0df-65eb-4426-bf3c-9a799ec9c342]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:13:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62bb73c2-85ee-4985-850c-d51572de66e2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:38 devstack sudo[105938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62bb73c2-85ee-4985-850c-d51572de66e2
Aug 26 17:13:38 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:38 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62bb73c2-85ee-4985-850c-d51572de66e2" returned: 0 in 0.395s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62bb73c2-85ee-4985-850c-d51572de66e2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:38 devstack sudo[105944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62bb73c2-85ee-4985-850c-d51572de66e2
Aug 26 17:13:38 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:38 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62bb73c2-85ee-4985-850c-d51572de66e2" returned: 0 in 0.243s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Lock "cinder-quobyte-62bb73c2-85ee-4985-850c-d51572de66e2" released by "delete_volume" :: held 0.691s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:39 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Created reservations ['470f9f9c-f09a-49c0-9ce3-01e4d19bcf59', '088f5614-af51-4916-8ece-35a63289e4f0', 'ff14f77d-bc63-40ff-a857-5ab31aaea7f4', 'b9644b5c-98d4-4cae-9214-5eadd8061b2c'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:13:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:39 devstack sudo[105949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:13:39 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:39 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.321s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:39 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:13:39 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Deleted volume successfully.
Aug 26 17:13:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bdb5d6c4-7f47-4500-b27b-4b98b2fc0be8 tempest-VolumesActionsTest-480769294 None] Lock "cinder-62bb73c2-85ee-4985-850c-d51572de66e2-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Flow 'volume_create_manager' (94f94aab-45d0-4bd2-92e6-55d068c0c18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db82256-2495-4ccd-8186-5ea30027a405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db82256-2495-4ccd-8186-5ea30027a405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-221031737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a14454a-f04a-46ac-9301-98c7e2ec64bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e91a0c97ac84191a60dcbd05912e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:40Z,use_quota=True,user_id='da9e37037dfd4c459a3bb8a051353256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8fcd341-af21-44af-9628-1a67f0770803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8fcd341-af21-44af-9628-1a67f0770803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb27fef-78ad-4cfe-aea3-895340a10b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb27fef-78ad-4cfe-aea3-895340a10b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a14454a-f04a-46ac-9301-98c7e2ec64bd', 'volume_name': 'volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7fbecf-dfb4-4e9e-b44f-5fcfc1f4dc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7fbecf-dfb4-4e9e-b44f-5fcfc1f4dc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f315cd4-ae8e-4129-95fa-0dc47ca140b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:40 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Volume 1a14454a-f04a-46ac-9301-98c7e2ec64bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd', 'volume_size': 1}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-221031737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a14454a-f04a-46ac-9301-98c7e2ec64bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e91a0c97ac84191a60dcbd05912e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:40Z,use_quota=True,user_id='da9e37037dfd4c459a3bb8a051353256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Creating volume 1a14454a-f04a-46ac-9301-98c7e2ec64bd {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:13:40 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:40 devstack sudo[105952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd 1073741824
Aug 26 17:13:40 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:40 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd 1073741824" returned: 0 in 0.705s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=108,cinder:UPDATE=117,cinder:INSERT=23,cinder:DELETE=11 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=115,cinder:SELECT=95,cinder:INSERT=27,cinder:DELETE=9 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:13:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:41 devstack sudo[105958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd
Aug 26 17:13:41 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:41 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd" returned: 0 in 0.391s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:13:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f315cd4-ae8e-4129-95fa-0dc47ca140b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa04ef9-30c1-400e-993f-f1a07ae5220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:41 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Volume volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd (1a14454a-f04a-46ac-9301-98c7e2ec64bd): created successfully
Aug 26 17:13:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa04ef9-30c1-400e-993f-f1a07ae5220b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Flow 'volume_create_manager' (94f94aab-45d0-4bd2-92e6-55d068c0c18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:41 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d56ca80a-ea89-4bcf-bfb6-d6f4ec19eb74 tempest-VolumesActionsTest-1938654129 None] Created volume successfully.
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:42 devstack sudo[105961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:13:42 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Acquiring lock "cinder-1a14454a-f04a-46ac-9301-98c7e2ec64bd-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Lock "cinder-1a14454a-f04a-46ac-9301-98c7e2ec64bd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Acquiring lock "cinder-quobyte-1a14454a-f04a-46ac-9301-98c7e2ec64bd" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Lock "cinder-quobyte-1a14454a-f04a-46ac-9301-98c7e2ec64bd" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae03f92-db3b-48c8-bccf-17edccedd890]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:13:42 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.534s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 28 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:13:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:13:42 devstack sudo[105966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd
Aug 26 17:13:42 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:43 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd" returned: 0 in 0.488s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:43 devstack sudo[105971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd
Aug 26 17:13:43 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:43 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1a14454a-f04a-46ac-9301-98c7e2ec64bd" returned: 0 in 0.371s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Lock "cinder-quobyte-1a14454a-f04a-46ac-9301-98c7e2ec64bd" released by "delete_volume" :: held 0.914s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Created reservations ['6fc549e3-3478-4600-923c-413bba80d429', '1e7f742e-394b-4f87-8dba-02b179d97112', '825065cf-9428-47b2-8da7-24db0c0ec0e1', '3ac4c665-82ea-433e-a1ce-91d88697f140'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Flow 'volume_create_manager' (b11df657-5040-4acc-aa78-6218e3d31ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b726f9-24f7-4ff0-b016-bc89605c7286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b726f9-24f7-4ff0-b016-bc89605c7286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-363772152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25eb56e0-e52c-43c5-967d-da5068d58497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56542fef448b460cb145f319b027b902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:44Z,use_quota=True,user_id='f93a8f4c3ef742f483512f64e9f5f84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710cac4d-7e92-4390-8ad3-1f67a5c9dbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710cac4d-7e92-4390-8ad3-1f67a5c9dbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c90748-dc62-4236-8d42-581a239ba524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c90748-dc62-4236-8d42-581a239ba524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25eb56e0-e52c-43c5-967d-da5068d58497', 'volume_name': 'volume-25eb56e0-e52c-43c5-967d-da5068d58497', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fe84af-b23c-40aa-aad5-5fe004345bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fe84af-b23c-40aa-aad5-5fe004345bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c028f4-9bec-4091-8f6a-4ff9e886e3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:43 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Volume 25eb56e0-e52c-43c5-967d-da5068d58497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25eb56e0-e52c-43c5-967d-da5068d58497', 'volume_size': 1}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-363772152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25eb56e0-e52c-43c5-967d-da5068d58497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56542fef448b460cb145f319b027b902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:44Z,use_quota=True,user_id='f93a8f4c3ef742f483512f64e9f5f84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Creating volume 25eb56e0-e52c-43c5-967d-da5068d58497 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:13:43 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-25eb56e0-e52c-43c5-967d-da5068d58497 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:43 devstack sudo[105977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-25eb56e0-e52c-43c5-967d-da5068d58497 1073741824
Aug 26 17:13:43 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:43 devstack sudo[105978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:13:43 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:44 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.325s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:13:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Deleted volume successfully.
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-15b360d2-3067-446c-bbc7-72ee429c46de tempest-VolumesActionsTest-480769294 None] Lock "cinder-1a14454a-f04a-46ac-9301-98c7e2ec64bd-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:44 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-25eb56e0-e52c-43c5-967d-da5068d58497 1073741824" returned: 0 in 0.648s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-25eb56e0-e52c-43c5-967d-da5068d58497 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:44 devstack sudo[105992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-25eb56e0-e52c-43c5-967d-da5068d58497
Aug 26 17:13:44 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-468c9962-9727-4554-ae0b-2dfc89e7f40c req-612bd380-ab66-4b48-9537-231225c3b93e tempest-TestServerVolumeAttachmentScenario-13529333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:44 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-25eb56e0-e52c-43c5-967d-da5068d58497" returned: 0 in 0.350s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-468c9962-9727-4554-ae0b-2dfc89e7f40c req-612bd380-ab66-4b48-9537-231225c3b93e tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.157s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c028f4-9bec-4091-8f6a-4ff9e886e3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25eb56e0-e52c-43c5-967d-da5068d58497', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f8fc93-f324-41a7-9a51-99b21b3f334b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-468c9962-9727-4554-ae0b-2dfc89e7f40c req-612bd380-ab66-4b48-9537-231225c3b93e tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:44 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Volume volume-25eb56e0-e52c-43c5-967d-da5068d58497 (25eb56e0-e52c-43c5-967d-da5068d58497): created successfully
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f8fc93-f324-41a7-9a51-99b21b3f334b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Flow 'volume_create_manager' (b11df657-5040-4acc-aa78-6218e3d31ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2f3f006c-d83f-4846-9c6f-69c717f8b6f6 tempest-AttachVolumeNegativeTest-749108113 None] Created volume successfully.
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-468c9962-9727-4554-ae0b-2dfc89e7f40c req-612bd380-ab66-4b48-9537-231225c3b93e tempest-TestServerVolumeAttachmentScenario-13529333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-e84d3829-06cd-4583-b18c-d79fc67c3573', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b02b4dbf-5062-4672-811e-898ef690eb39', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:13:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-468c9962-9727-4554-ae0b-2dfc89e7f40c req-612bd380-ab66-4b48-9537-231225c3b93e tempest-TestServerVolumeAttachmentScenario-13529333 None] attachment_update completed successfully.
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Flow 'volume_create_manager' (b338bfa4-2206-4d5d-b32b-243629093d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f8c748-3948-49d0-ad0e-6c88e91b0fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f8c748-3948-49d0-ad0e-6c88e91b0fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025972811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be83c7b4-5c01-4120-9992-a34cbf2a126c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e91a0c97ac84191a60dcbd05912e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:45Z,use_quota=True,user_id='da9e37037dfd4c459a3bb8a051353256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9e02bf-9598-4a90-91aa-2b40f806fa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9e02bf-9598-4a90-91aa-2b40f806fa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d33acc7-16c0-4013-a8cc-b195b5b03e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d33acc7-16c0-4013-a8cc-b195b5b03e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be83c7b4-5c01-4120-9992-a34cbf2a126c', 'volume_name': 'volume-be83c7b4-5c01-4120-9992-a34cbf2a126c', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6af9b8-1c69-4064-887a-cd65b256f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6af9b8-1c69-4064-887a-cd65b256f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2f7ec2-b21d-4d2f-9198-d17436353de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:45 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Volume be83c7b4-5c01-4120-9992-a34cbf2a126c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be83c7b4-5c01-4120-9992-a34cbf2a126c', 'volume_size': 1}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025972811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be83c7b4-5c01-4120-9992-a34cbf2a126c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e91a0c97ac84191a60dcbd05912e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:13:45Z,use_quota=True,user_id='da9e37037dfd4c459a3bb8a051353256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Creating volume be83c7b4-5c01-4120-9992-a34cbf2a126c {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:13:45 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:13:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-be83c7b4-5c01-4120-9992-a34cbf2a126c 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:45 devstack sudo[106001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-be83c7b4-5c01-4120-9992-a34cbf2a126c 1073741824
Aug 26 17:13:45 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:46 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-be83c7b4-5c01-4120-9992-a34cbf2a126c 1073741824" returned: 0 in 0.618s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-be83c7b4-5c01-4120-9992-a34cbf2a126c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:46 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-be83c7b4-5c01-4120-9992-a34cbf2a126c
Aug 26 17:13:46 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:46 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-be83c7b4-5c01-4120-9992-a34cbf2a126c" returned: 0 in 0.297s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2f7ec2-b21d-4d2f-9198-d17436353de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be83c7b4-5c01-4120-9992-a34cbf2a126c', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f472495e-a6bc-46c7-a22c-168775937d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:13:46 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Volume volume-be83c7b4-5c01-4120-9992-a34cbf2a126c (be83c7b4-5c01-4120-9992-a34cbf2a126c): created successfully
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f472495e-a6bc-46c7-a22c-168775937d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Flow 'volume_create_manager' (b338bfa4-2206-4d5d-b32b-243629093d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:13:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7518435a-cd80-4533-90d0-69268c4678b3 tempest-VolumesActionsTest-1938654129 None] Created volume successfully.
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-fe4c4908-fe18-43d3-b103-b0ecf2bceb78 req-0e110e72-73a5-4b72-ba0c-98d2e553dda6 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-fe4c4908-fe18-43d3-b103-b0ecf2bceb78 req-0e110e72-73a5-4b72-ba0c-98d2e553dda6 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-fe4c4908-fe18-43d3-b103-b0ecf2bceb78 req-0e110e72-73a5-4b72-ba0c-98d2e553dda6 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-fe4c4908-fe18-43d3-b103-b0ecf2bceb78 req-0e110e72-73a5-4b72-ba0c-98d2e553dda6 tempest-AttachVolumeNegativeTest-749108113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-25eb56e0-e52c-43c5-967d-da5068d58497', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c18dbb7-824f-4e61-8381-4ec3ab3d3032', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:13:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-fe4c4908-fe18-43d3-b103-b0ecf2bceb78 req-0e110e72-73a5-4b72-ba0c-98d2e553dda6 tempest-AttachVolumeNegativeTest-749108113 None] attachment_update completed successfully.
Aug 26 17:13:47 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-5f9bcb86-e84c-4ec5-a217-5aa1d07082bc req-3c2a33a3-21b0-4617-bc28-c4ae4123df0e tempest-TestServerVolumeAttachmentScenario-13529333 None] Terminate volume connection completed successfully.
Aug 26 17:13:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-5f9bcb86-e84c-4ec5-a217-5aa1d07082bc req-3c2a33a3-21b0-4617-bc28-c4ae4123df0e tempest-TestServerVolumeAttachmentScenario-13529333 None] Deleting attachment b02b4dbf-5062-4672-811e-898ef690eb39. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:13:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "cinder-be83c7b4-5c01-4120-9992-a34cbf2a126c-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Lock "cinder-be83c7b4-5c01-4120-9992-a34cbf2a126c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "cinder-quobyte-be83c7b4-5c01-4120-9992-a34cbf2a126c" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:13:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Lock "cinder-quobyte-be83c7b4-5c01-4120-9992-a34cbf2a126c" acquired by "delete_volume" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:13:48 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a330f68-feb3-4d6c-8a2b-ccc605fcd567]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:13:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-be83c7b4-5c01-4120-9992-a34cbf2a126c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:48 devstack sudo[106047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-be83c7b4-5c01-4120-9992-a34cbf2a126c
Aug 26 17:13:48 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:49 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-be83c7b4-5c01-4120-9992-a34cbf2a126c" returned: 0 in 0.508s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-be83c7b4-5c01-4120-9992-a34cbf2a126c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:49 devstack sudo[106052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-be83c7b4-5c01-4120-9992-a34cbf2a126c
Aug 26 17:13:49 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:49 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-be83c7b4-5c01-4120-9992-a34cbf2a126c" returned: 0 in 0.378s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Lock "cinder-quobyte-be83c7b4-5c01-4120-9992-a34cbf2a126c" released by "delete_volume" :: held 0.954s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:13:49 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Created reservations ['e6842d4b-8641-4d35-9ee1-cf40558e0f2c', '5a26a5e9-47f8-46c0-b76b-25d4e55c71f3', 'bb0626f9-575b-4c3b-9e6c-d7e3735e5afd', 'db59799b-2425-4811-8b21-ec601b3cada8'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:13:49 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-46c02061-0bbf-4353-a0ee-1d491b4458c9 req-f343bb6d-79a9-48ea-8ab1-feac7dc7e360 tempest-TestServerVolumeAttachmentScenario-13529333 None] Terminate volume connection completed successfully.
Aug 26 17:13:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-46c02061-0bbf-4353-a0ee-1d491b4458c9 req-f343bb6d-79a9-48ea-8ab1-feac7dc7e360 tempest-TestServerVolumeAttachmentScenario-13529333 None] Deleting attachment 5a042006-bb3e-44e2-a3ed-ab38ccf2ffae. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:13:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:13:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:13:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:13:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:13:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:13:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:13:49 devstack sudo[106062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:13:49 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:13:50 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root
Aug 26 17:13:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.471s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:13:50 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:13:50 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Deleted volume successfully.
Aug 26 17:13:50 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-9d70ac58-44dd-401d-afe3-e0c3f724acc7 req-59ff7aa7-8653-47d1-9bff-f88039e5effc tempest-AttachVolumeNegativeTest-749108113 None] Terminate volume connection completed successfully.
Aug 26 17:13:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-9d70ac58-44dd-401d-afe3-e0c3f724acc7 req-59ff7aa7-8653-47d1-9bff-f88039e5effc tempest-AttachVolumeNegativeTest-749108113 None] Deleting attachment 2c18dbb7-824f-4e61-8381-4ec3ab3d3032. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:13:50 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eb93222a-3ee8-4aee-b1b3-a3021bbd7df3 tempest-VolumesActionsTest-1938654129 None] Lock "cinder-be83c7b4-5c01-4120-9992-a34cbf2a126c-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=20,cinder:SELECT=36,cinder:INSERT=5,cinder:DELETE=2 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=26,cinder:INSERT=6,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Flow 'volume_create_manager' (f160a9ef-7a16-467e-8d29-1ddda9d4e770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3246211d-96b5-4b91-b4a0-ce05c49bd57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3246211d-96b5-4b91-b4a0-ce05c49bd57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10387090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc8adb0-56dd-4240-ba33-fb4920b769f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657810a5aab045a4873e38a57ed0df01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:00Z,use_quota=True,user_id='8fb51fb96b394b3a923fb81d1e679625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20263ae0-a314-4cfd-b52d-9227a1727f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20263ae0-a314-4cfd-b52d-9227a1727f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a5a545-4244-42bd-9cea-a216319f76ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a5a545-4244-42bd-9cea-a216319f76ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfc8adb0-56dd-4240-ba33-fb4920b769f5', 'volume_name': 'volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a07774-6bd9-4c2b-97a2-98be3e2e0ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a07774-6bd9-4c2b-97a2-98be3e2e0ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c99d5ea-3ad4-4577-a80a-9541aa285308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:00 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Volume bfc8adb0-56dd-4240-ba33-fb4920b769f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5', 'volume_size': 1}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10387090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc8adb0-56dd-4240-ba33-fb4920b769f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657810a5aab045a4873e38a57ed0df01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:00Z,use_quota=True,user_id='8fb51fb96b394b3a923fb81d1e679625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Creating volume bfc8adb0-56dd-4240-ba33-fb4920b769f5 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:14:00 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:14:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:00 devstack sudo[106148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 1073741824
Aug 26 17:14:00 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:01 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 1073741824" returned: 0 in 0.565s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:01 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5
Aug 26 17:14:01 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:01 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5" returned: 0 in 0.290s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Acquiring lock "cinder-e84d3829-06cd-4583-b18c-d79fc67c3573-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c99d5ea-3ad4-4577-a80a-9541aa285308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e758f448-b0d5-4c87-a651-5184d97bcc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "cinder-e84d3829-06cd-4583-b18c-d79fc67c3573-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:01 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Volume volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 (bfc8adb0-56dd-4240-ba33-fb4920b769f5): created successfully
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e758f448-b0d5-4c87-a651-5184d97bcc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Flow 'volume_create_manager' (f160a9ef-7a16-467e-8d29-1ddda9d4e770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:14:01 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8f3b047e-9933-44dc-a5f3-7848b88da2f8 tempest-VolumesActionsTest-71604734 None] Created volume successfully.
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Acquiring lock "cinder-quobyte-e84d3829-06cd-4583-b18c-d79fc67c3573" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "cinder-quobyte-e84d3829-06cd-4583-b18c-d79fc67c3573" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2282d41-0376-45d5-b5db-5ffbc32cba8e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e84d3829-06cd-4583-b18c-d79fc67c3573 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:01 devstack sudo[106157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e84d3829-06cd-4583-b18c-d79fc67c3573
Aug 26 17:14:01 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "cinder-25eb56e0-e52c-43c5-967d-da5068d58497-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Lock "cinder-25eb56e0-e52c-43c5-967d-da5068d58497-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:02 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e84d3829-06cd-4583-b18c-d79fc67c3573" returned: 0 in 0.497s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e84d3829-06cd-4583-b18c-d79fc67c3573 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:02 devstack sudo[106162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e84d3829-06cd-4583-b18c-d79fc67c3573
Aug 26 17:14:02 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "cinder-quobyte-25eb56e0-e52c-43c5-967d-da5068d58497" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Lock "cinder-quobyte-25eb56e0-e52c-43c5-967d-da5068d58497" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[210c5c3f-62a1-4aa6-a08d-5a108597b527]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-25eb56e0-e52c-43c5-967d-da5068d58497 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:02 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-25eb56e0-e52c-43c5-967d-da5068d58497
Aug 26 17:14:02 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:02 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e84d3829-06cd-4583-b18c-d79fc67c3573" returned: 0 in 0.274s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "cinder-quobyte-e84d3829-06cd-4583-b18c-d79fc67c3573" released by "delete_volume" :: held 0.825s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Created reservations ['225e9fb5-ad20-4555-b9f3-e573ad0bf6bc', '105a53a5-f584-45e6-b2ea-33730010926d', '942fc1a9-8e6e-49d2-80b4-e0d313fd72fe', '7ecdba0d-fbc7-41d0-994d-c2c7ce22f86a'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:02 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:02 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:14:02 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-25eb56e0-e52c-43c5-967d-da5068d58497" returned: 0 in 0.409s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-25eb56e0-e52c-43c5-967d-da5068d58497 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Acquiring lock "cinder-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:02 devstack sudo[106172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-25eb56e0-e52c-43c5-967d-da5068d58497
Aug 26 17:14:02 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "cinder-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Acquiring lock "cinder-quobyte-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "cinder-quobyte-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec" acquired by "delete_volume" :: waited 0.043s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad09b52-23d6-40e3-ae35-341d6418ad47]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:02 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.336s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:14:02 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Deleted volume successfully.
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-693ce71e-c42a-4e98-aac8-6c783f7c2629 tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "cinder-e84d3829-06cd-4583-b18c-d79fc67c3573-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:02 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-25eb56e0-e52c-43c5-967d-da5068d58497" returned: 0 in 0.386s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Lock "cinder-quobyte-25eb56e0-e52c-43c5-967d-da5068d58497" released by "delete_volume" :: held 0.858s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:03 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec
Aug 26 17:14:03 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Created reservations ['910efe29-856c-4711-88d9-af9ab802f8c6', 'd361704b-a49a-446b-961d-9bba8b7f437e', '0bef287e-0e70-4341-b742-58572e765172', 'ffb1c7e1-5361-4fb2-ab08-063a02555e96'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:03 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:14:03 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:03 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec" returned: 0 in 0.537s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:03 devstack sudo[106184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec
Aug 26 17:14:03 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:03 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.293s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:14:03 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Deleted volume successfully.
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7ce454fd-0ea9-4d32-83e6-dbac18ea9e53 tempest-AttachVolumeNegativeTest-749108113 None] Lock "cinder-25eb56e0-e52c-43c5-967d-da5068d58497-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:03 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec" returned: 0 in 0.389s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "cinder-quobyte-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec" released by "delete_volume" :: held 0.992s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Created reservations ['79f55d07-cd24-4181-b766-4cbe354dbda3', '7e2d8e46-1d95-4490-b8ad-4b9cc4cf1a67', '297fd664-91ca-4c1a-8720-fdc0e88f8929', '36b503ca-7731-40dc-8764-68c18851cdae'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:04 devstack sudo[106191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:14:04 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:04 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.328s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:04 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:14:04 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Deleted volume successfully.
Aug 26 17:14:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5f3a09fc-3ad8-4e52-83b0-a1a596cf0b1c tempest-TestServerVolumeAttachmentScenario-13529333 None] Lock "cinder-9cc78f3f-2a4f-49a2-8d10-2b7a6ad400ec-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "cinder-cff3d47e-08bb-43cc-a107-9b9c2ee9648d-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Lock "cinder-cff3d47e-08bb-43cc-a107-9b9c2ee9648d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "cinder-quobyte-cff3d47e-08bb-43cc-a107-9b9c2ee9648d" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Lock "cinder-quobyte-cff3d47e-08bb-43cc-a107-9b9c2ee9648d" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:04 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaba8e9-d749-45f8-bfd1-c7c8bd49dcbf]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:04 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d
Aug 26 17:14:04 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:05 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d" returned: 0 in 0.534s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:05 devstack sudo[106202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d
Aug 26 17:14:05 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:05 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cff3d47e-08bb-43cc-a107-9b9c2ee9648d" returned: 0 in 0.427s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Lock "cinder-quobyte-cff3d47e-08bb-43cc-a107-9b9c2ee9648d" released by "delete_volume" :: held 1.024s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:05 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Created reservations ['f944f23b-0c96-4f10-be52-dd83bd1bf714', '45e07c54-6208-4c60-a2ec-06e7b52064c4', '4599f020-f825-4dfa-8e9e-5d4ff6a63eee', 'e9509a49-5b3a-4c56-bc4f-7a2d49ee314c'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:14:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:05 devstack sudo[106216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:14:05 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:06 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.393s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:06 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:14:06 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Deleted volume successfully.
Aug 26 17:14:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-79008d95-e137-4174-9047-6671c188a8f3 tempest-AttachVolumeNegativeTest-749108113 None] Lock "cinder-cff3d47e-08bb-43cc-a107-9b9c2ee9648d-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "cinder-3bf4973f-3553-4bdc-b7fa-764af3ba201c-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Lock "cinder-3bf4973f-3553-4bdc-b7fa-764af3ba201c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "cinder-quobyte-3bf4973f-3553-4bdc-b7fa-764af3ba201c" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Lock "cinder-quobyte-3bf4973f-3553-4bdc-b7fa-764af3ba201c" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:07 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8d6f69-1015-4122-b53e-ca0c59045f91]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:07 devstack sudo[106225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c
Aug 26 17:14:07 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:07 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c" returned: 0 in 0.452s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:07 devstack sudo[106230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c
Aug 26 17:14:07 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:07 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3bf4973f-3553-4bdc-b7fa-764af3ba201c" returned: 0 in 0.290s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Lock "cinder-quobyte-3bf4973f-3553-4bdc-b7fa-764af3ba201c" released by "delete_volume" :: held 0.803s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:08 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Created reservations ['4ca78c58-83a8-4793-9af0-a71c897dae3a', '1d788110-5bd8-48a4-9150-f25cb8b99a0c', 'e0823eec-09e7-46e9-b555-1b6793879243', '7260e86f-f09d-4205-98b4-54006e5f9f2e'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:14:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:08 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:14:08 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:08 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.446s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:08 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:14:08 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Deleted volume successfully.
Aug 26 17:14:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7e1895f3-b05f-4239-babb-5ff5f2792d66 tempest-AttachVolumeNegativeTest-749108113 None] Lock "cinder-3bf4973f-3553-4bdc-b7fa-764af3ba201c-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Flow 'volume_create_manager' (b719ec75-88ef-48c2-8aa7-100c2743161c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed356363-60f0-461f-b332-ce462ff89aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed356363-60f0-461f-b332-ce462ff89aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1128869074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c32478-f38e-4fd6-a978-e372b15bd1d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b213370f7b0a47048b8964e4ea0744e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:13Z,use_quota=True,user_id='2328fa1f5f4e47a6af976170fbc3189a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab025f0-601a-48fb-bd19-d7d7c508ec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab025f0-601a-48fb-bd19-d7d7c508ec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba739f2a-20f8-447e-a8c1-a6ba377d97cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba739f2a-20f8-447e-a8c1-a6ba377d97cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c32478-f38e-4fd6-a978-e372b15bd1d1', 'volume_name': 'volume-28c32478-f38e-4fd6-a978-e372b15bd1d1', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4391c089-eaca-4562-bda6-2727f2584f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4391c089-eaca-4562-bda6-2727f2584f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf02d87-0b23-4542-a713-54c71923310a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:13 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Volume 28c32478-f38e-4fd6-a978-e372b15bd1d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c32478-f38e-4fd6-a978-e372b15bd1d1', 'volume_size': 1}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1128869074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c32478-f38e-4fd6-a978-e372b15bd1d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b213370f7b0a47048b8964e4ea0744e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:13Z,use_quota=True,user_id='2328fa1f5f4e47a6af976170fbc3189a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Creating volume 28c32478-f38e-4fd6-a978-e372b15bd1d1 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:14:13 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:14:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:13 devstack sudo[106257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 1073741824
Aug 26 17:14:13 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:14 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 1073741824" returned: 0 in 0.814s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:14 devstack sudo[106306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1
Aug 26 17:14:14 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:15 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1" returned: 0 in 0.459s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:14:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf02d87-0b23-4542-a713-54c71923310a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c32478-f38e-4fd6-a978-e372b15bd1d1', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67eb0f7a-4943-409c-b964-87d8f276cb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:15 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Volume volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 (28c32478-f38e-4fd6-a978-e372b15bd1d1): created successfully
Aug 26 17:14:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67eb0f7a-4943-409c-b964-87d8f276cb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Flow 'volume_create_manager' (b719ec75-88ef-48c2-8aa7-100c2743161c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:14:15 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-3bf3b709-7a01-42f3-8fdc-bd2f33029a4c tempest-VolumesCloneTest-523002155 None] Created volume successfully.
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Flow 'volume_create_manager' (1736b145-acad-4fa5-9bfb-3f4985ce154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf351674-8fdd-4c50-93c6-737aa7586d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf351674-8fdd-4c50-93c6-737aa7586d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-121149905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a5e083-9060-4c77-b5e9-24d277c21c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b213370f7b0a47048b8964e4ea0744e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=28c32478-f38e-4fd6-a978-e372b15bd1d1,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:16Z,use_quota=True,user_id='2328fa1f5f4e47a6af976170fbc3189a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7490471e-8ac4-4c3d-b603-a5a692f0213b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7490471e-8ac4-4c3d-b603-a5a692f0213b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3faafe0b-05dc-461f-82fd-89e242f14621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3faafe0b-05dc-461f-82fd-89e242f14621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '31a5e083-9060-4c77-b5e9-24d277c21c48', 'volume_name': 'volume-31a5e083-9060-4c77-b5e9-24d277c21c48', 'volume_size': 2, 'source_volid': '28c32478-f38e-4fd6-a978-e372b15bd1d1', 'source_volstatus': 'available'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b14261-9560-4d82-b931-11f37d9a966b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b14261-9560-4d82-b931-11f37d9a966b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ad03c7-1e68-43b8-bcc7-bd82e39ed178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:16 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Volume 31a5e083-9060-4c77-b5e9-24d277c21c48: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-31a5e083-9060-4c77-b5e9-24d277c21c48', 'volume_size': 2, 'source_volid': '28c32478-f38e-4fd6-a978-e372b15bd1d1', 'source_volstatus': 'available'}
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:16 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Cloning volume 28c32478-f38e-4fd6-a978-e372b15bd1d1 to volume 31a5e083-9060-4c77-b5e9-24d277c21c48
Aug 26 17:14:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Creating offline snapshot c34f02d9-0a79-4b8d-b963-a319bd6531bf of volume 28c32478-f38e-4fd6-a978-e372b15bd1d1 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:14:17 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d672387-1dc3-44b2-a358-50f6d390ad53]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:17 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1
Aug 26 17:14:17 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:17 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1" returned: 0 in 0.609s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:17 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf 1G
Aug 26 17:14:17 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:18 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf 1G" returned: 0 in 0.697s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:18 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf
Aug 26 17:14:18 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:18 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf" returned: 0 in 0.473s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:18 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf is being set with open permissions: ugo+rw
Aug 26 17:14:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:18 devstack sudo[106388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf
Aug 26 17:14:18 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:19 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf" returned: 0 in 0.406s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b8422d0d-a464-4e39-9ea3-f50ec9d1c72c tempest-VolumesActionsTest-71604734 None] Acquiring lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5" by "attach_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b8422d0d-a464-4e39-9ea3-f50ec9d1c72c tempest-VolumesActionsTest-71604734 None] Lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5" acquired by "attach_volume" :: waited 0.127s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:19 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.info
Aug 26 17:14:19 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b8422d0d-a464-4e39-9ea3-f50ec9d1c72c tempest-VolumesActionsTest-71604734 None] Attaching volume bfc8adb0-56dd-4240-ba33-fb4920b769f5 to instance 1061c083-9ffe-44e5-8034-f7d24bc88d55 at mountpoint /dev/vdb on host None.
Aug 26 17:14:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b8422d0d-a464-4e39-9ea3-f50ec9d1c72c tempest-VolumesActionsTest-71604734 None] Attach volume completed successfully.
Aug 26 17:14:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b8422d0d-a464-4e39-9ea3-f50ec9d1c72c tempest-VolumesActionsTest-71604734 None] Lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5" released by "attach_volume" :: held 0.170s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ed90215e-fc17-4f05-9497-6f388b798216 tempest-VolumesActionsTest-71604734 None] Acquiring lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5-detach_volume" by "detach_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ed90215e-fc17-4f05-9497-6f388b798216 tempest-VolumesActionsTest-71604734 None] Lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ed90215e-fc17-4f05-9497-6f388b798216 tempest-VolumesActionsTest-71604734 None] Detaching volume bfc8adb0-56dd-4240-ba33-fb4920b769f5 from instance 1061c083-9ffe-44e5-8034-f7d24bc88d55.
Aug 26 17:14:19 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.info" returned: 0 in 0.518s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:19 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.info is being set with open permissions: ugo+rw
Aug 26 17:14:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:19 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.info
Aug 26 17:14:19 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ed90215e-fc17-4f05-9497-6f388b798216 tempest-VolumesActionsTest-71604734 None] Detach volume completed successfully.
Aug 26 17:14:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ed90215e-fc17-4f05-9497-6f388b798216 tempest-VolumesActionsTest-71604734 None] Lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5-detach_volume" released by "detach_volume" :: held 0.164s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:20 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.info" returned: 0 in 0.537s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Acquiring lock "cinder-quobyte-31a5e083-9060-4c77-b5e9-24d277c21c48" by "_copy_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Lock "cinder-quobyte-31a5e083-9060-4c77-b5e9-24d277c21c48" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] snapshot: c34f02d9-0a79-4b8d-b963-a319bd6531bf, volume: 31a5e083-9060-4c77-b5e9-24d277c21c48,  {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 26 17:14:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:20 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b1e5e8-0ab2-494f-a9bb-2466c77df2a0]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:20 devstack sudo[106398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf
Aug 26 17:14:20 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:21 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf" returned: 0 in 0.693s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28c32478-f38e-4fd6-a978-e372b15bd1d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:14:21 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d389f613-74af-43f9-b6a1-1b08e86651ea]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:21 devstack sudo[106428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1
Aug 26 17:14:21 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:21 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1" returned: 0 in 0.602s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 26 17:14:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Creating direct copy from snapshot {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 26 17:14:21 devstack cinder-volume[94125]: DEBUG cinder.utils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Path /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48 not found in is_blk_device check {{(pid=94125) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 26 17:14:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:21 devstack sudo[106434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48
Aug 26 17:14:21 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:21 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:14:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Flow 'volume_create_manager' (d1a9b77b-6642-431b-8f09-d598a0f5e182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:14:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fd400a-a599-4621-b67f-18f26b64d157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fd400a-a599-4621-b67f-18f26b64d157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1120648499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72f5a4a-d017-4d29-83e0-29368c93429f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90168234e4048b399b861efeedd6634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:22Z,use_quota=True,user_id='d34323af007642c6b061787f33357727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58019028-84aa-469c-bcaf-88bb18a2635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58019028-84aa-469c-bcaf-88bb18a2635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6802f517-3da8-4bf3-9ee9-79c6a383d3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6802f517-3da8-4bf3-9ee9-79c6a383d3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72f5a4a-d017-4d29-83e0-29368c93429f', 'volume_name': 'volume-c72f5a4a-d017-4d29-83e0-29368c93429f', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c35312-557b-4c30-9f63-cab4beac0742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c35312-557b-4c30-9f63-cab4beac0742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad36e31a-2d40-4678-b55a-855e17a4e0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:22 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Volume c72f5a4a-d017-4d29-83e0-29368c93429f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72f5a4a-d017-4d29-83e0-29368c93429f', 'volume_size': 1}
Aug 26 17:14:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:27 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48" returned: 0 in 6.018s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:27 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:14:27 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Converted 1024.00 MB image at 170.08 MB/s
Aug 26 17:14:27 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48 is being set with open permissions: ugo+rw
Aug 26 17:14:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:27 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48
Aug 26 17:14:27 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:28 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48" returned: 0 in 0.288s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Lock "cinder-quobyte-31a5e083-9060-4c77-b5e9-24d277c21c48" released by "_copy_volume_from_snapshot" :: held 7.716s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Acquiring lock "cinder-quobyte-c34f02d9-0a79-4b8d-b963-a319bd6531bf" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Lock "cinder-quobyte-c34f02d9-0a79-4b8d-b963-a319bd6531bf" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Deleting offline snapshot c34f02d9-0a79-4b8d-b963-a319bd6531bf of volume 28c32478-f38e-4fd6-a978-e372b15bd1d1 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:14:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] snapshot_file for this snap is: volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:14:28 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe70fa5-f176-4495-a0f9-8eba10086c6b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:28 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf
Aug 26 17:14:28 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:28 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf" returned: 0 in 0.608s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28c32478-f38e-4fd6-a978-e372b15bd1d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:14:28 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de031c5-bce7-431f-bb01-2e1f1ff50c62]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:29 devstack sudo[106484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1
Aug 26 17:14:29 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:29 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1" returned: 0 in 0.605s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:29 devstack sudo[106489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf
Aug 26 17:14:29 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:29 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf" returned: 0 in 0.444s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:30 devstack sudo[106494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf
Aug 26 17:14:30 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:30 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1.c34f02d9-0a79-4b8d-b963-a319bd6531bf" returned: 0 in 0.338s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Lock "cinder-quobyte-c34f02d9-0a79-4b8d-b963-a319bd6531bf" released by "_delete_snapshot" :: held 2.143s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.624s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.353s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1120648499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72f5a4a-d017-4d29-83e0-29368c93429f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90168234e4048b399b861efeedd6634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:22Z,use_quota=True,user_id='d34323af007642c6b061787f33357727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Creating volume c72f5a4a-d017-4d29-83e0-29368c93429f {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:14:30 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c72f5a4a-d017-4d29-83e0-29368c93429f 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:30 devstack sudo[106498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c72f5a4a-d017-4d29-83e0-29368c93429f 1073741824
Aug 26 17:14:30 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ad03c7-1e68-43b8-bcc7-bd82e39ed178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a5e083-9060-4c77-b5e9-24d277c21c48', 'volume_size': 2, 'source_volid': '28c32478-f38e-4fd6-a978-e372b15bd1d1', 'source_volstatus': 'available'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1a3cda-8af3-4ba8-80db-fbe34f2270dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:30 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Volume volume-31a5e083-9060-4c77-b5e9-24d277c21c48 (31a5e083-9060-4c77-b5e9-24d277c21c48): created successfully
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1a3cda-8af3-4ba8-80db-fbe34f2270dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Flow 'volume_create_manager' (1736b145-acad-4fa5-9bfb-3f4985ce154a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:14:30 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d8350cb0-c3bc-4f1d-8595-fb06cd54bd6d tempest-VolumesCloneTest-523002155 None] Created volume successfully.
Aug 26 17:14:31 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c72f5a4a-d017-4d29-83e0-29368c93429f 1073741824" returned: 0 in 0.747s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c72f5a4a-d017-4d29-83e0-29368c93429f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:31 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c72f5a4a-d017-4d29-83e0-29368c93429f
Aug 26 17:14:31 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Acquiring lock "cinder-31a5e083-9060-4c77-b5e9-24d277c21c48-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Lock "cinder-31a5e083-9060-4c77-b5e9-24d277c21c48-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Acquiring lock "cinder-quobyte-31a5e083-9060-4c77-b5e9-24d277c21c48" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Lock "cinder-quobyte-31a5e083-9060-4c77-b5e9-24d277c21c48" acquired by "delete_volume" :: waited 0.045s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:31 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e40827c-ab9c-433e-8dad-cb2354b98701]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:31 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c72f5a4a-d017-4d29-83e0-29368c93429f" returned: 0 in 0.699s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:14:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad36e31a-2d40-4678-b55a-855e17a4e0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72f5a4a-d017-4d29-83e0-29368c93429f', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf4da63-cdd8-4d19-b697-d366c30f2c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:32 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Volume volume-c72f5a4a-d017-4d29-83e0-29368c93429f (c72f5a4a-d017-4d29-83e0-29368c93429f): created successfully
Aug 26 17:14:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf4da63-cdd8-4d19-b697-d366c30f2c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Flow 'volume_create_manager' (d1a9b77b-6642-431b-8f09-d598a0f5e182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:14:32 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-0d606bc8-7c82-4f03-b514-7ba06bb324da req-93581917-0245-44ad-bf4a-fbf7e77be386 tempest-VolumesGetTestJSON-1307311209 None] Created volume successfully.
Aug 26 17:14:32 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48
Aug 26 17:14:32 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:32 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48" returned: 0 in 0.704s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:32 devstack sudo[106579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48
Aug 26 17:14:32 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:33 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-31a5e083-9060-4c77-b5e9-24d277c21c48" returned: 0 in 0.445s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Lock "cinder-quobyte-31a5e083-9060-4c77-b5e9-24d277c21c48" released by "delete_volume" :: held 1.227s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Created reservations ['039ee081-6a43-495e-9830-9fd041aab556', 'feb2ce94-a1c7-4705-bdce-877f3be147f5', 'b846f500-ece8-4df8-ac87-a9a9a3ca54c1', '4e9f3700-2be5-4a41-a4f9-34c3c789c273'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Acquiring lock "cinder-c72f5a4a-d017-4d29-83e0-29368c93429f-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Lock "cinder-c72f5a4a-d017-4d29-83e0-29368c93429f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Acquiring lock "cinder-quobyte-c72f5a4a-d017-4d29-83e0-29368c93429f" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Lock "cinder-quobyte-c72f5a4a-d017-4d29-83e0-29368c93429f" acquired by "delete_volume" :: waited 0.090s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:33 devstack sudo[106598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:14:33 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb75e56e-7d09-4c76-afbf-90cab0a143de]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c72f5a4a-d017-4d29-83e0-29368c93429f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:33 devstack sudo[106600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c72f5a4a-d017-4d29-83e0-29368c93429f
Aug 26 17:14:33 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:33 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.449s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:14:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Deleted volume successfully.
Aug 26 17:14:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dab6ac55-2a66-4b29-a967-69377874fe12 tempest-VolumesCloneTest-523002155 None] Lock "cinder-31a5e083-9060-4c77-b5e9-24d277c21c48-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:34 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c72f5a4a-d017-4d29-83e0-29368c93429f" returned: 0 in 0.578s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c72f5a4a-d017-4d29-83e0-29368c93429f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:34 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c72f5a4a-d017-4d29-83e0-29368c93429f
Aug 26 17:14:34 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Acquiring lock "cinder-28c32478-f38e-4fd6-a978-e372b15bd1d1-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Lock "cinder-28c32478-f38e-4fd6-a978-e372b15bd1d1-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Acquiring lock "cinder-quobyte-28c32478-f38e-4fd6-a978-e372b15bd1d1" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Lock "cinder-quobyte-28c32478-f38e-4fd6-a978-e372b15bd1d1" acquired by "delete_volume" :: waited 0.058s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:34 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c72f5a4a-d017-4d29-83e0-29368c93429f" returned: 0 in 0.619s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:34 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fe83fb-ce5d-4fe4-b43b-49fd4ad6b653]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Lock "cinder-quobyte-c72f5a4a-d017-4d29-83e0-29368c93429f" released by "delete_volume" :: held 1.316s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:34 devstack cinder-volume[94125]: DEBUG cinder.quota [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Created reservations ['335765b3-9f4d-499c-a1b6-5446d9dbde64', '1b616e6b-d4b0-4937-a551-9ceb7a5931f2', '32c0f192-b996-48bf-a87f-510d16fde509', 'd4349d72-48e7-4676-8d4d-353115378527'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:14:34 devstack sudo[106611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1
Aug 26 17:14:34 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:35 devstack sudo[106613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:14:35 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:35 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1" returned: 0 in 0.628s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:35 devstack sudo[106618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1
Aug 26 17:14:35 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:35 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.453s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG cinder.manager [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:14:35 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Deleted volume successfully.
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-99bbbb8b-0f20-481e-9d98-bd85043c4afb req-490ea789-1b4f-477b-bf7f-988823cc05f2 tempest-VolumesGetTestJSON-1307311209 None] Lock "cinder-c72f5a4a-d017-4d29-83e0-29368c93429f-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:35 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-28c32478-f38e-4fd6-a978-e372b15bd1d1" returned: 0 in 0.446s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Lock "cinder-quobyte-28c32478-f38e-4fd6-a978-e372b15bd1d1" released by "delete_volume" :: held 1.217s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:35 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Created reservations ['532148ce-d015-4f55-8eab-3c03c21d44e3', '24bcdf9a-486c-4b8f-8af3-afafddb63e3f', '8f5c4a01-cc80-42ae-9661-b15f8eb3645d', 'b92073e7-b914-4ab8-9afe-f8ea8739653f'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:36 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:14:36 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-500fe70e-8563-49c0-bb66-9bca4e175b47 tempest-VolumesActionsTest-71604734 None] Acquiring lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5" by "attach_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-500fe70e-8563-49c0-bb66-9bca4e175b47 tempest-VolumesActionsTest-71604734 None] Lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5" acquired by "attach_volume" :: waited 0.047s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-500fe70e-8563-49c0-bb66-9bca4e175b47 tempest-VolumesActionsTest-71604734 None] Attaching volume bfc8adb0-56dd-4240-ba33-fb4920b769f5 to instance a67c86f0-116b-408b-ba30-1d396e58f119 at mountpoint /dev/vdb on host None.
Aug 26 17:14:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-500fe70e-8563-49c0-bb66-9bca4e175b47 tempest-VolumesActionsTest-71604734 None] Attach volume completed successfully.
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-500fe70e-8563-49c0-bb66-9bca4e175b47 tempest-VolumesActionsTest-71604734 None] Lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5" released by "attach_volume" :: held 0.283s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:36 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.517s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:14:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Deleted volume successfully.
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-28d6cd57-6ed0-461b-8b06-c273c330f65a tempest-VolumesCloneTest-523002155 None] Lock "cinder-28c32478-f38e-4fd6-a978-e372b15bd1d1-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-488561a2-8dfc-49d7-8052-639f458d745f tempest-VolumesActionsTest-71604734 None] Acquiring lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5-detach_volume" by "detach_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:14:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-488561a2-8dfc-49d7-8052-639f458d745f tempest-VolumesActionsTest-71604734 None] Lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:14:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-488561a2-8dfc-49d7-8052-639f458d745f tempest-VolumesActionsTest-71604734 None] Detaching volume bfc8adb0-56dd-4240-ba33-fb4920b769f5 from instance a67c86f0-116b-408b-ba30-1d396e58f119.
Aug 26 17:14:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-488561a2-8dfc-49d7-8052-639f458d745f tempest-VolumesActionsTest-71604734 None] Detach volume completed successfully.
Aug 26 17:14:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-488561a2-8dfc-49d7-8052-639f458d745f tempest-VolumesActionsTest-71604734 None] Lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:14:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:14:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:42 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:14:42 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:42 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.481s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:14:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:14:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 28 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:14:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Flow 'volume_create_manager' (b8cdb746-0e9e-4ed2-b5e0-ad4065841556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e45ce6-86fe-4c25-80a1-afce703b5d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e45ce6-86fe-4c25-80a1-afce703b5d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-300210735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d925d3dd83f24e72b6a5ef76cd1ec666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:43Z,use_quota=True,user_id='6d7fec56c441465980c0b145cdc8054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7dc3a4-fb5f-4ca8-baf6-482b72221496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7dc3a4-fb5f-4ca8-baf6-482b72221496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fd344d-c54d-4b44-b0ad-f43b7994713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fd344d-c54d-4b44-b0ad-f43b7994713f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7', 'volume_name': 'volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52ef01d-986a-41b9-a765-2fb2d0ef7229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52ef01d-986a-41b9-a765-2fb2d0ef7229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a75057-b1ff-4087-a925-780bd9ad3de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:43 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Volume fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7', 'volume_size': 1}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-300210735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d925d3dd83f24e72b6a5ef76cd1ec666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:43Z,use_quota=True,user_id='6d7fec56c441465980c0b145cdc8054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Creating volume fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:14:43 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:14:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:43 devstack sudo[106660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7 1073741824
Aug 26 17:14:43 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-69b957b2-42b3-4638-86a4-08867970a7c9 tempest-GroupSnapshotsV319Test-275627484 None] Group tempest-GroupSnapshotsV319Test-Group-1967573162: creating
Aug 26 17:14:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-69b957b2-42b3-4638-86a4-08867970a7c9 tempest-GroupSnapshotsV319Test-275627484 None] Group tempest-GroupSnapshotsV319Test-Group-1967573162: created successfully
Aug 26 17:14:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-69b957b2-42b3-4638-86a4-08867970a7c9 tempest-GroupSnapshotsV319Test-275627484 None] Create group completed successfully.
Aug 26 17:14:44 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7 1073741824" returned: 0 in 0.609s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:44 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7
Aug 26 17:14:44 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:44 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7" returned: 0 in 0.283s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.067s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc081367-1b7b-4615-913b-014a94564ce3]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a75057-b1ff-4087-a925-780bd9ad3de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb028572-1ed4-450a-bcca-c650188f50f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:44 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Volume volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7 (fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7): created successfully
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb028572-1ed4-450a-bcca-c650188f50f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Flow 'volume_create_manager' (b8cdb746-0e9e-4ed2-b5e0-ad4065841556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:14:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-11619901-9eba-4005-b611-41f27f6f9623 tempest-VolumesListTestJSON-226898503 None] Created volume successfully.
Aug 26 17:14:44 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5
Aug 26 17:14:44 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:45 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5" returned: 0 in 0.401s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:45 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df8080f-ee71-455b-b077-844f0a53cfc6]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:45 devstack sudo[106676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5
Aug 26 17:14:45 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:45 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5" returned: 0 in 0.477s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.9bdc0f4c-3d75-45ff-be1f-832831f5e4ad3y5g4dh8.img {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:45 devstack sudo[106681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.9bdc0f4c-3d75-45ff-be1f-832831f5e4ad3y5g4dh8.img
Aug 26 17:14:45 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:45 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Flow 'volume_create_manager' (60c27de7-4c7f-4bdb-9b18-8484effc9466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed7b7d2-c655-46c0-bade-3c70dd21179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed7b7d2-c655-46c0-bade-3c70dd21179c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142116841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ca7797d8-b7bf-4ae9-9633-d3c9f37de6a3,host='devstack@QuobyteHD#QuobyteHD',id=b409c1a0-753b-41c8-8197-bbd369edc435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbd085a671c45df914437194c0a33df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:46Z,use_quota=True,user_id='b444e0b4f1e0401bb8725ce5eebc46be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e349de1c-1174-42b5-864d-22e6421cbaa5),volume_type_id=e349de1c-1174-42b5-864d-22e6421cbaa5)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8f9139-279b-45c3-95cd-c1a717488813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8f9139-279b-45c3-95cd-c1a717488813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e32790e-314f-4c7d-b974-0ba6f27d95ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e32790e-314f-4c7d-b974-0ba6f27d95ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b409c1a0-753b-41c8-8197-bbd369edc435', 'volume_name': 'volume-b409c1a0-753b-41c8-8197-bbd369edc435', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87fb7a0c-513c-40e7-8f93-ecf1405b3c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87fb7a0c-513c-40e7-8f93-ecf1405b3c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff2f0cc-164e-49ed-9e8e-7b06fde51ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:46 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Volume b409c1a0-753b-41c8-8197-bbd369edc435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b409c1a0-753b-41c8-8197-bbd369edc435', 'volume_size': 1}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Flow 'volume_create_manager' (0bafcb83-8d5a-4300-b0fd-744eabac941f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92407523-3eb5-4ceb-862c-93f84abfa83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92407523-3eb5-4ceb-862c-93f84abfa83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-52703197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e368c63-60ee-4329-aa39-d23595ebdb7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d925d3dd83f24e72b6a5ef76cd1ec666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:46Z,use_quota=True,user_id='6d7fec56c441465980c0b145cdc8054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7f93e0-c0d6-4843-8bc2-8b155c07ebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7f93e0-c0d6-4843-8bc2-8b155c07ebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5cabfa-29c1-4139-a152-cc2e30404b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5cabfa-29c1-4139-a152-cc2e30404b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e368c63-60ee-4329-aa39-d23595ebdb7a', 'volume_name': 'volume-9e368c63-60ee-4329-aa39-d23595ebdb7a', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161d4e71-b488-4732-8ab2-cc813622ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161d4e71-b488-4732-8ab2-cc813622ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b177203-68ce-4e1c-baa9-fbde1857bb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:14:46 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Volume 9e368c63-60ee-4329-aa39-d23595ebdb7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e368c63-60ee-4329-aa39-d23595ebdb7a', 'volume_size': 1}
Aug 26 17:14:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:14:50 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.9bdc0f4c-3d75-45ff-be1f-832831f5e4ad3y5g4dh8.img" returned: 0 in 5.223s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:50 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6344116-6d8d-46cf-b246-afb715f96b95]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:14:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:14:50 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5
Aug 26 17:14:50 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:14:51 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Aug 26 17:14:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5" returned: 0 in 0.555s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:14:51 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.9bdc0f4c-3d75-45ff-be1f-832831f5e4ad3y5g4dh8.img {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:14:51 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] Converted 1024.00 MB image at 196.01 MB/s
Aug 26 17:14:51 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] 9bdc0f4c-3d75-45ff-be1f-832831f5e4ad was raw, no need to convert to raw {{(pid=94125) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Aug 26 17:15:00 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=76,cinder:INSERT=20,cinder:UPDATE=90,cinder:DELETE=5 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:15:00 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=88,cinder:DELETE=8,cinder:SELECT=67,cinder:INSERT=23 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:15:00 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:15:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Flow 'volume_create_manager' (c71ce81b-0ce2-48a5-b409-c84b1153e8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52faa45f-7d71-4647-8c8f-5e3099115752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52faa45f-7d71-4647-8c8f-5e3099115752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1577837923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce02064f-7014-461c-977e-a64793509d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f26cc07d984222af8eb8247e5090b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:01Z,use_quota=True,user_id='b5f0c4cd45af4726b8e12db29fd536ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2ca15c-fc28-4c07-8dd1-a1337f85ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2ca15c-fc28-4c07-8dd1-a1337f85ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10aaf3ac-c89a-471c-a163-ec95e3fa2332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG cinder.image.glance [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Creating Keystone auth plugin from conf {{(pid=94125) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10aaf3ac-c89a-471c-a163-ec95e3fa2332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce02064f-7014-461c-977e-a64793509d30', 'volume_name': 'volume-ce02064f-7014-461c-977e-a64793509d30', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fcc0cad0>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e352e7-5117-41c4-8e64-924172e2471b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e352e7-5117-41c4-8e64-924172e2471b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f531b0c2-bec9-4997-ac02-cace5096ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:01 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Volume ce02064f-7014-461c-977e-a64793509d30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce02064f-7014-461c-977e-a64793509d30', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fcc0cad0>}
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Trying to clone ce02064f-7014-461c-977e-a64793509d30 from image b24297bc-5b4d-44da-a168-9014960429c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]). {{(pid=94125) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 17:15:01 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Image download 20.69 MB at 20.69 MB/s
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[419a4a7f-736d-48ae-9a04-f2594ef8d873]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:01 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD
Aug 26 17:15:01 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:02 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:02 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Temporary image b24297bc-5b4d-44da-a168-9014960429c1 is fetched for user b5f0c4cd45af4726b8e12db29fd536ca. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 17:15:02 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[9522f00b-f626-4597-9ee7-260f71a4f805]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:02 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD
Aug 26 17:15:02 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:02 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.967s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] Uploaded volume to glance image-id: 9bdc0f4c-3d75-45ff-be1f-832831f5e4ad. {{(pid=94125) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 26 17:15:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.379s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ca7797d8-b7bf-4ae9-9633-d3c9f37de6a3,created_at=2026-08-26T15:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142116841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ca7797d8-b7bf-4ae9-9633-d3c9f37de6a3,host='devstack@QuobyteHD#QuobyteHD',id=b409c1a0-753b-41c8-8197-bbd369edc435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbd085a671c45df914437194c0a33df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:46Z,use_quota=True,user_id='b444e0b4f1e0401bb8725ce5eebc46be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e349de1c-1174-42b5-864d-22e6421cbaa5),volume_type_id=e349de1c-1174-42b5-864d-22e6421cbaa5)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:15:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Creating volume b409c1a0-753b-41c8-8197-bbd369edc435 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:15:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:15:11 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:15:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:11 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-48f113dd-a0c6-4519-9b6b-cef235b4225a tempest-VolumesActionsTest-71604734 None] Copy volume to image completed successfully.
Aug 26 17:15:11 devstack sudo[106720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435 1073741824
Aug 26 17:15:11 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:12 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435 1073741824" returned: 0 in 0.480s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:12 devstack sudo[106725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435
Aug 26 17:15:12 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:12 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435" returned: 0 in 0.294s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.787s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-52703197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e368c63-60ee-4329-aa39-d23595ebdb7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d925d3dd83f24e72b6a5ef76cd1ec666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:14:46Z,use_quota=True,user_id='6d7fec56c441465980c0b145cdc8054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Creating volume 9e368c63-60ee-4329-aa39-d23595ebdb7a {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:15:12 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9e368c63-60ee-4329-aa39-d23595ebdb7a 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff2f0cc-164e-49ed-9e8e-7b06fde51ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b409c1a0-753b-41c8-8197-bbd369edc435', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:12 devstack sudo[106728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9e368c63-60ee-4329-aa39-d23595ebdb7a 1073741824
Aug 26 17:15:12 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8f1200-66b3-4c37-9383-1ba2081338a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Volume volume-b409c1a0-753b-41c8-8197-bbd369edc435 (b409c1a0-753b-41c8-8197-bbd369edc435): created successfully
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8f1200-66b3-4c37-9383-1ba2081338a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Flow 'volume_create_manager' (60c27de7-4c7f-4bdb-9b18-8484effc9466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:12 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6bed234d-3545-4e12-b64f-29a28faf4191 tempest-GroupSnapshotsV319Test-275627484 None] Created volume successfully.
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:12 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9e368c63-60ee-4329-aa39-d23595ebdb7a 1073741824" returned: 0 in 0.456s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9e368c63-60ee-4329-aa39-d23595ebdb7a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:12 devstack sudo[106733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9e368c63-60ee-4329-aa39-d23595ebdb7a
Aug 26 17:15:12 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:13 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9e368c63-60ee-4329-aa39-d23595ebdb7a" returned: 0 in 0.256s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.515s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1577837923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce02064f-7014-461c-977e-a64793509d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f26cc07d984222af8eb8247e5090b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:01Z,use_quota=True,user_id='b5f0c4cd45af4726b8e12db29fd536ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Creating volume ce02064f-7014-461c-977e-a64793509d30 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:15:13 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b177203-68ce-4e1c-baa9-fbde1857bb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e368c63-60ee-4329-aa39-d23595ebdb7a', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:13 devstack sudo[106736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30 1073741824
Aug 26 17:15:13 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8323a8d1-28ab-4db5-8a97-1448b56b59d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:13 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Volume volume-9e368c63-60ee-4329-aa39-d23595ebdb7a (9e368c63-60ee-4329-aa39-d23595ebdb7a): created successfully
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8323a8d1-28ab-4db5-8a97-1448b56b59d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Flow 'volume_create_manager' (0bafcb83-8d5a-4300-b0fd-744eabac941f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:13 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-9c593ac8-370a-4182-b808-de3de6889602 tempest-VolumesListTestJSON-226898503 None] Created volume successfully.
Aug 26 17:15:13 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] GroupSnapshot 99e6057e-1cd6-4bff-9770-60634d9a4002: creating.
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] Group snapshot 99e6057e-1cd6-4bff-9770-60634d9a4002: creating. {{(pid=94125) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:13 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30 1073741824" returned: 0 in 0.469s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:13 devstack sudo[106741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30
Aug 26 17:15:13 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:13 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30" returned: 0 in 0.300s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.306s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1228a6-9d93-4981-8a9e-67aaeca4fdce]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Flow 'volume_create_manager' (1ead76ff-5ef2-42f6-bb28-b84e69654ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4f56bc-418a-4cd1-b8a1-5971c878d5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4f56bc-418a-4cd1-b8a1-5971c878d5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-20219724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546467c1-4918-45e9-8341-63f77143d044,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d925d3dd83f24e72b6a5ef76cd1ec666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:14Z,use_quota=True,user_id='6d7fec56c441465980c0b145cdc8054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71df5a4-8bb8-4f30-9bea-29b669e61b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71df5a4-8bb8-4f30-9bea-29b669e61b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd27957-1914-429b-afba-932f90f1d386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd27957-1914-429b-afba-932f90f1d386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '546467c1-4918-45e9-8341-63f77143d044', 'volume_name': 'volume-546467c1-4918-45e9-8341-63f77143d044', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2a02ce-e6af-4691-8e99-bc30b967c04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2a02ce-e6af-4691-8e99-bc30b967c04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a2a85e-d65b-4e86-82f0-2537e2ceac3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:14 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Volume 546467c1-4918-45e9-8341-63f77143d044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-546467c1-4918-45e9-8341-63f77143d044', 'volume_size': 1}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Attempting download of b24297bc-5b4d-44da-a168-9014960429c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}])) to volume ce02064f-7014-461c-977e-a64793509d30. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 17:15:14 devstack sudo[106744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5
Aug 26 17:15:14 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ecf8ea-cf94-47cc-890e-8bfb6a0ca209]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_5sc1zz4l {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:14 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_5sc1zz4l
Aug 26 17:15:14 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:14 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5" returned: 0 in 0.397s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77ab965-03dc-484f-8fe7-91eaefce95c8]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:14 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_5sc1zz4l" returned: 0 in 0.338s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_5sc1zz4l {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:14 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5
Aug 26 17:15:14 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:14 devstack sudo[106754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_5sc1zz4l
Aug 26 17:15:14 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:14 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5" returned: 0 in 0.388s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:14 devstack sudo[106762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img
Aug 26 17:15:14 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:14 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_5sc1zz4l" returned: 1 in 0.350s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_5sc1zz4l' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b76161-80ce-40f7-a987-ab10b697eb7c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:14 devstack sudo[106765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD
Aug 26 17:15:14 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:15 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:15 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] b24297bc-5b4d-44da-a168-9014960429c1 was qcow2, converting to qcow2 {{(pid=94125) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 17:15:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:15 devstack sudo[106781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30
Aug 26 17:15:15 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:19 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30" returned: 0 in 3.894s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1__n7_anzrdevstack@QuobyteHD, size 112.00 MB, duration 3.90 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:15:19 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Converted 112.00 MB image at 28.75 MB/s
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:19 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img" returned: 0 in 4.532s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:19 devstack sudo[106826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30 1G
Aug 26 17:15:19 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e7d9b3-2f4b-413a-a980-be4939dbbda3]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:19 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5
Aug 26 17:15:19 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:19 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30 1G" returned: 0 in 0.324s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Downloaded image b24297bc-5b4d-44da-a168-9014960429c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}])) to volume ce02064f-7014-461c-977e-a64793509d30 successfully. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Temporary image b24297bc-5b4d-44da-a168-9014960429c1 for user b5f0c4cd45af4726b8e12db29fd536ca is deleted. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Marking volume ce02064f-7014-461c-977e-a64793509d30 as bootable. {{(pid=94125) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Copying metadata from image b24297bc-5b4d-44da-a168-9014960429c1 to ce02064f-7014-461c-977e-a64793509d30. {{(pid=94125) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Creating volume glance metadata for volume ce02064f-7014-461c-977e-a64793509d30 backed by image b24297bc-5b4d-44da-a168-9014960429c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94125) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f531b0c2-bec9-4997-ac02-cace5096ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce02064f-7014-461c-977e-a64793509d30', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fcc0cad0>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83110624-8c1e-480f-a30a-1c01ed7db338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:19 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Volume volume-ce02064f-7014-461c-977e-a64793509d30 (ce02064f-7014-461c-977e-a64793509d30): created successfully
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83110624-8c1e-480f-a30a-1c01ed7db338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Flow 'volume_create_manager' (c71ce81b-0ce2-48a5-b409-c84b1153e8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-82053b51-cac3-47e8-930e-9c19011450fa tempest-TestShelveInstance-1648727836 None] Created volume successfully.
Aug 26 17:15:19 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5" returned: 0 in 0.541s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:15:19 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Converted 1024.00 MB image at 225.89 MB/s
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] 525783fe-2b84-41ee-a00e-f2d3e18914ab was raw, converting to qcow2 {{(pid=94125) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceb07b2-9102-4264-9fad-36a72b21174b]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:20 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img
Aug 26 17:15:20 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:20 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img" returned: 0 in 0.322s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:20 devstack sudo[106840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img
Aug 26 17:15:20 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:20 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img" returned: 1 in 0.346s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:15:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img /opt/stack/data/cinder/conversion/vol_upload_qayx8mre {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:20 devstack sudo[106845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img /opt/stack/data/cinder/conversion/vol_upload_qayx8mre
Aug 26 17:15:20 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:20 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img /opt/stack/data/cinder/conversion/vol_upload_qayx8mre" returned: 0 in 0.263s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:20 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Image conversion details: src /opt/stack/data/cinder/conversion/bfc8adb0-56dd-4240-ba33-fb4920b769f5.temp_image.525783fe-2b84-41ee-a00e-f2d3e18914abwl8nfo2g.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_qayx8mre {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:15:20 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Converted 1024.00 MB image at 1024.00 MB/s
Aug 26 17:15:20 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[08da7d41-dc54-44e3-89ce-9038db61cf0f]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qayx8mre {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:20 devstack sudo[106851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qayx8mre
Aug 26 17:15:20 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:21 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qayx8mre" returned: 0 in 0.326s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.668s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Uploaded volume to glance image-id: 525783fe-2b84-41ee-a00e-f2d3e18914ab. {{(pid=94125) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 26 17:15:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.319s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] Creating offline snapshot 2f202777-c266-462f-b1d9-5421a83028db of volume b409c1a0-753b-41c8-8197-bbd369edc435 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:15:22 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-15dce19b-8d23-40c6-9b0a-e07e43c3025e tempest-VolumesActionsTest-71604734 None] Copy volume to image completed successfully.
Aug 26 17:15:22 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[108bd1ae-55cf-4334-8056-29eed3f160a4]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:22 devstack sudo[106859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435
Aug 26 17:15:22 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:23 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435" returned: 0 in 0.424s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:23 devstack sudo[106872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db 1G
Aug 26 17:15:23 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-74ae759a-8222-4f9b-b92b-5a7248870f92 req-f9e5330c-0c44-4b8a-b373-5799ce6028d3 tempest-TestShelveInstance-1648727836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:23 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db 1G" returned: 0 in 0.539s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b409c1a0-753b-41c8-8197-bbd369edc435 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:23 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b409c1a0-753b-41c8-8197-bbd369edc435 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db
Aug 26 17:15:23 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Acquiring lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Acquiring lock "cinder-quobyte-bfc8adb0-56dd-4240-ba33-fb4920b769f5" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Lock "cinder-quobyte-bfc8adb0-56dd-4240-ba33-fb4920b769f5" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:24 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b409c1a0-753b-41c8-8197-bbd369edc435 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db" returned: 0 in 0.574s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:24 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc768ff7-7b69-446e-a1ce-a634bcf8fcc5]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:24 devstack sudo[106884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db
Aug 26 17:15:24 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:24 devstack sudo[106885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5
Aug 26 17:15:24 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:24 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db" returned: 0 in 0.254s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:24 devstack sudo[106889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.info
Aug 26 17:15:24 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:24 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5" returned: 0 in 0.406s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:24 devstack sudo[106894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5
Aug 26 17:15:24 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:24 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.info" returned: 0 in 0.301s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:24 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:24 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.info
Aug 26 17:15:24 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:24 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bfc8adb0-56dd-4240-ba33-fb4920b769f5" returned: 0 in 0.304s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Lock "cinder-quobyte-bfc8adb0-56dd-4240-ba33-fb4920b769f5" released by "delete_volume" :: held 0.766s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Created reservations ['b8a44e07-7d47-4d56-9224-479a01bc17f7', '6c570b28-6a04-44ef-9b89-d3827dc4e23c', '018f17a6-1e69-411e-ae2e-099cb766cb75', '0f8d45a9-8e93-46ec-bac8-876fd2226b07'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:15:25 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.info" returned: 0 in 0.271s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.029s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-20219724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546467c1-4918-45e9-8341-63f77143d044,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d925d3dd83f24e72b6a5ef76cd1ec666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:14Z,use_quota=True,user_id='6d7fec56c441465980c0b145cdc8054e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Creating volume 546467c1-4918-45e9-8341-63f77143d044 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:15:25 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-546467c1-4918-45e9-8341-63f77143d044 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:25 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-546467c1-4918-45e9-8341-63f77143d044 1073741824
Aug 26 17:15:25 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:25 devstack sudo[106903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:15:25 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:25 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-29bf02e5-1c21-45e3-90b2-16c7a8196755 tempest-GroupSnapshotsV319Test-275627484 None] group_snapshot 99e6057e-1cd6-4bff-9770-60634d9a4002: created successfully
Aug 26 17:15:25 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.438s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:15:25 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Deleted volume successfully.
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-182741b4-6851-4e89-a3f6-97e783a8bb80 tempest-VolumesActionsTest-71604734 None] Lock "cinder-bfc8adb0-56dd-4240-ba33-fb4920b769f5-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:25 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-546467c1-4918-45e9-8341-63f77143d044 1073741824" returned: 0 in 0.593s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-546467c1-4918-45e9-8341-63f77143d044 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:25 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-546467c1-4918-45e9-8341-63f77143d044
Aug 26 17:15:25 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:26 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-546467c1-4918-45e9-8341-63f77143d044" returned: 0 in 0.271s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-74ae759a-8222-4f9b-b92b-5a7248870f92 req-f9e5330c-0c44-4b8a-b373-5799ce6028d3 tempest-TestShelveInstance-1648727836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.802s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a2a85e-d65b-4e86-82f0-2537e2ceac3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-546467c1-4918-45e9-8341-63f77143d044', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1b739c-830e-45f1-8d3c-9ac74e4fc758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-74ae759a-8222-4f9b-b92b-5a7248870f92 req-f9e5330c-0c44-4b8a-b373-5799ce6028d3 tempest-TestShelveInstance-1648727836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:26 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Volume volume-546467c1-4918-45e9-8341-63f77143d044 (546467c1-4918-45e9-8341-63f77143d044): created successfully
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1b739c-830e-45f1-8d3c-9ac74e4fc758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Flow 'volume_create_manager' (1ead76ff-5ef2-42f6-bb28-b84e69654ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:26 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b77277a6-91f2-4797-8221-333e8a5e7280 tempest-VolumesListTestJSON-226898503 None] Created volume successfully.
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-74ae759a-8222-4f9b-b92b-5a7248870f92 req-f9e5330c-0c44-4b8a-b373-5799ce6028d3 tempest-TestShelveInstance-1648727836 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-ce02064f-7014-461c-977e-a64793509d30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ae1ccd2-fe68-4c92-94ff-a6d709acf4ae', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:15:26 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-74ae759a-8222-4f9b-b92b-5a7248870f92 req-f9e5330c-0c44-4b8a-b373-5799ce6028d3 tempest-TestShelveInstance-1648727836 None] attachment_update completed successfully.
Aug 26 17:15:26 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] group_snapshot 99e6057e-1cd6-4bff-9770-60634d9a4002: deleting
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] group_snapshot 99e6057e-1cd6-4bff-9770-60634d9a4002: deleting {{(pid=94125) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Acquiring lock "cinder-quobyte-b409c1a0-753b-41c8-8197-bbd369edc435" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Lock "cinder-quobyte-b409c1a0-753b-41c8-8197-bbd369edc435" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Acquiring lock "cinder-quobyte-2f202777-c266-462f-b1d9-5421a83028db" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Lock "cinder-quobyte-2f202777-c266-462f-b1d9-5421a83028db" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Deleting offline snapshot 2f202777-c266-462f-b1d9-5421a83028db of volume b409c1a0-753b-41c8-8197-bbd369edc435 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:15:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] snapshot_file for this snap is: volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:15:27 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f658dcbb-da2b-4ca8-bf08-1b8d8fea5b83]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:27 devstack sudo[106982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db
Aug 26 17:15:27 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:27 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db" returned: 0 in 0.759s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b409c1a0-753b-41c8-8197-bbd369edc435(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:15:27 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b51c693-5bf2-43be-8f48-12babbc70e07]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:27 devstack sudo[107344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435
Aug 26 17:15:27 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:28 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435" returned: 0 in 0.655s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:28 devstack sudo[107370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db
Aug 26 17:15:28 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:29 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db" returned: 0 in 0.525s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:29 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db
Aug 26 17:15:29 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:29 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435.2f202777-c266-462f-b1d9-5421a83028db" returned: 0 in 0.412s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Lock "cinder-quobyte-2f202777-c266-462f-b1d9-5421a83028db" released by "_delete_snapshot" :: held 2.540s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Lock "cinder-quobyte-b409c1a0-753b-41c8-8197-bbd369edc435" released by "delete_snapshot" :: held 2.575s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:29 devstack cinder-volume[94125]: WARNING cinder.quota [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-70011092 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-70011092, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:15:29 devstack cinder-volume[94125]: WARNING cinder.quota [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-70011092 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-70011092, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:15:29 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] Created reservations ['afe10d3c-7e8c-4911-90cf-3379dc49b621', 'e9df42b6-3521-4a8d-8e2e-72e9cec5849e', 'c6f605aa-93db-4fa6-b0e3-541872ceb0c6', 'e98cdcc5-cc5e-4733-9cca-1d5163b07469'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:15:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-41810262-acec-416f-9f78-67e17975ba68 tempest-GroupSnapshotsV319Test-275627484 None] group_snapshot 99e6057e-1cd6-4bff-9770-60634d9a4002: deleted successfully
Aug 26 17:15:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "cinder-546467c1-4918-45e9-8341-63f77143d044-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Acquiring lock "cinder-quobyte-b409c1a0-753b-41c8-8197-bbd369edc435" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Lock "cinder-546467c1-4918-45e9-8341-63f77143d044-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Lock "cinder-quobyte-b409c1a0-753b-41c8-8197-bbd369edc435" acquired by "delete_volume" :: waited 0.065s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:31 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b755f918-da58-4879-a114-9b0767544443]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "cinder-quobyte-546467c1-4918-45e9-8341-63f77143d044" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Lock "cinder-quobyte-546467c1-4918-45e9-8341-63f77143d044" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:31 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ba845d-c909-4141-b7ed-e3b11a4db525]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-546467c1-4918-45e9-8341-63f77143d044 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:31 devstack sudo[107405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435
Aug 26 17:15:31 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:31 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-546467c1-4918-45e9-8341-63f77143d044
Aug 26 17:15:31 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:32 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-546467c1-4918-45e9-8341-63f77143d044" returned: 0 in 0.655s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-546467c1-4918-45e9-8341-63f77143d044 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:32 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435" returned: 0 in 0.788s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:32 devstack sudo[107415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-546467c1-4918-45e9-8341-63f77143d044
Aug 26 17:15:32 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:32 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435
Aug 26 17:15:32 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:32 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b409c1a0-753b-41c8-8197-bbd369edc435" returned: 0 in 0.565s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Lock "cinder-quobyte-b409c1a0-753b-41c8-8197-bbd369edc435" released by "delete_volume" :: held 1.492s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:32 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-546467c1-4918-45e9-8341-63f77143d044" returned: 0 in 0.753s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Lock "cinder-quobyte-546467c1-4918-45e9-8341-63f77143d044" released by "delete_volume" :: held 1.487s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:32 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Created reservations ['fc71cbfe-d126-4b19-84d1-b25eef4c2df9'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:15:32 devstack cinder-volume[94125]: WARNING cinder.quota [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-70011092 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-70011092, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:15:32 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Created reservations ['588fbf3f-c26f-4130-9672-181555c8751c', 'ae4ebdd4-cc8b-41c8-9dde-e1c574e22e49', '346753e4-8fb2-41b6-bfa7-80d5d3a9dd31', '84dd7302-250e-4313-8e87-c49648e9bb92'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:15:32 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Created reservations ['3235b590-fa59-4e59-a1f6-578842adacff', '95fee723-c4af-4757-8c23-bf3a4517d8f8', '053196b4-b9a1-4701-bd15-cc48aabf9370', '2d351c30-8437-4ca5-800e-fa10575a4305'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:33 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:15:33 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:33 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:15:33 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:33 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.457s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:15:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Deleted volume successfully.
Aug 26 17:15:33 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.457s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c91f1d1a-9bcf-4e0e-a973-e4a71906b2d8 tempest-VolumesListTestJSON-226898503 None] Lock "cinder-546467c1-4918-45e9-8341-63f77143d044-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-56d7c9ea-a041-4e57-ac78-a7f12c476130 tempest-GroupSnapshotsV319Test-275627484 None] Delete group completed successfully.
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "cinder-9e368c63-60ee-4329-aa39-d23595ebdb7a-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Lock "cinder-9e368c63-60ee-4329-aa39-d23595ebdb7a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "cinder-quobyte-9e368c63-60ee-4329-aa39-d23595ebdb7a" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Lock "cinder-quobyte-9e368c63-60ee-4329-aa39-d23595ebdb7a" acquired by "delete_volume" :: waited 0.044s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aedb1d-da65-484d-b91c-eef39e28ae17]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9e368c63-60ee-4329-aa39-d23595ebdb7a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:34 devstack sudo[107428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9e368c63-60ee-4329-aa39-d23595ebdb7a
Aug 26 17:15:34 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:34 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9e368c63-60ee-4329-aa39-d23595ebdb7a" returned: 0 in 0.720s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9e368c63-60ee-4329-aa39-d23595ebdb7a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:34 devstack sudo[107433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9e368c63-60ee-4329-aa39-d23595ebdb7a
Aug 26 17:15:34 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:35 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-9e368c63-60ee-4329-aa39-d23595ebdb7a" returned: 0 in 0.549s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Lock "cinder-quobyte-9e368c63-60ee-4329-aa39-d23595ebdb7a" released by "delete_volume" :: held 1.336s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:35 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Created reservations ['629a24e6-8735-4aa9-865c-e33d6cfcdb3b', 'fd7d7a17-d101-4236-b040-1a982506d885', '21ec6d40-d9f2-4315-8693-82fbae800ab0', 'a3d8beb5-057c-4403-8d3a-99dc7fbbf6d5'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:15:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:35 devstack sudo[107436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:15:35 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:35 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.461s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:35 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:15:35 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Deleted volume successfully.
Aug 26 17:15:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-80ad751d-a299-4801-a3e9-e889b67b6830 tempest-VolumesListTestJSON-226898503 None] Lock "cinder-9e368c63-60ee-4329-aa39-d23595ebdb7a-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "cinder-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Lock "cinder-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "cinder-quobyte-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Lock "cinder-quobyte-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7" acquired by "delete_volume" :: waited 0.040s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:36 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2183d8af-73f4-41c1-b4a5-8594229e9d94]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:36 devstack sudo[107442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7
Aug 26 17:15:36 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:37 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7" returned: 0 in 0.641s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:37 devstack sudo[107448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7
Aug 26 17:15:37 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Flow 'volume_create_manager' (20fc90e4-8703-4878-9376-cfacf8a30f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d352e168-479e-4434-88da-eb1a9fbd9354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d352e168-479e-4434-88da-eb1a9fbd9354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1323148770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea91095-f4ab-4f77-89ed-5521feebff95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f7e614316545a8bf3fbb52e7b485fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:37Z,use_quota=True,user_id='97d0d538b0b644e3ab8af1f3f28b46c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a5bbee-e4c3-49c1-92fd-ac2df0e55798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a5bbee-e4c3-49c1-92fd-ac2df0e55798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b46fb7-e165-4376-9681-cfc9f10f68c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b46fb7-e165-4376-9681-cfc9f10f68c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea91095-f4ab-4f77-89ed-5521feebff95', 'volume_name': 'volume-eea91095-f4ab-4f77-89ed-5521feebff95', 'volume_size': 2}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2971c772-89c3-4e2e-b26c-4743c242a687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2971c772-89c3-4e2e-b26c-4743c242a687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfb45d3-ba4c-4657-a7ea-796acc22c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:37 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Volume eea91095-f4ab-4f77-89ed-5521feebff95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea91095-f4ab-4f77-89ed-5521feebff95', 'volume_size': 2}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1323148770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea91095-f4ab-4f77-89ed-5521feebff95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f7e614316545a8bf3fbb52e7b485fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:37Z,use_quota=True,user_id='97d0d538b0b644e3ab8af1f3f28b46c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Creating volume eea91095-f4ab-4f77-89ed-5521feebff95 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:15:37 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eea91095-f4ab-4f77-89ed-5521feebff95 2147483648 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:37 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eea91095-f4ab-4f77-89ed-5521feebff95 2147483648
Aug 26 17:15:37 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:37 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7" returned: 0 in 0.441s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Lock "cinder-quobyte-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7" released by "delete_volume" :: held 1.174s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Created reservations ['03021b7d-8200-4248-af06-ee995d778359', '21f33214-415e-47b3-a511-82908089fb5c', '88ccdf37-d0db-4838-a89c-61a440ef9e0f', 'cc5d2088-7125-4607-a51d-1e3c16ebef3e'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:38 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:15:38 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:38 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.354s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:38 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:15:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Deleted volume successfully.
Aug 26 17:15:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ab385c6-4383-4bee-98e0-188663459370 tempest-VolumesListTestJSON-226898503 None] Lock "cinder-fa3e90a0-e418-4c84-8e08-b9ef12f5f6d7-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:38 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eea91095-f4ab-4f77-89ed-5521feebff95 2147483648" returned: 0 in 0.870s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eea91095-f4ab-4f77-89ed-5521feebff95 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:38 devstack sudo[107461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eea91095-f4ab-4f77-89ed-5521feebff95
Aug 26 17:15:38 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:38 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eea91095-f4ab-4f77-89ed-5521feebff95" returned: 0 in 0.310s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:15:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfb45d3-ba4c-4657-a7ea-796acc22c27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea91095-f4ab-4f77-89ed-5521feebff95', 'volume_size': 2}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb3dbfc-a30f-4811-b63f-81e1bf9a1b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:38 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Volume volume-eea91095-f4ab-4f77-89ed-5521feebff95 (eea91095-f4ab-4f77-89ed-5521feebff95): created successfully
Aug 26 17:15:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb3dbfc-a30f-4811-b63f-81e1bf9a1b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Flow 'volume_create_manager' (20fc90e4-8703-4878-9376-cfacf8a30f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e22a5191-77e7-4be9-a107-4b3c484c67bd tempest-VolumesCloneNegativeTest-145626274 None] Created volume successfully.
Aug 26 17:15:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Acquiring lock "cinder-eea91095-f4ab-4f77-89ed-5521feebff95-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Lock "cinder-eea91095-f4ab-4f77-89ed-5521feebff95-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Acquiring lock "cinder-quobyte-eea91095-f4ab-4f77-89ed-5521feebff95" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Lock "cinder-quobyte-eea91095-f4ab-4f77-89ed-5521feebff95" acquired by "delete_volume" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:39 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb49f25-5c2c-4212-83ee-6442247618f8]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eea91095-f4ab-4f77-89ed-5521feebff95 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:40 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eea91095-f4ab-4f77-89ed-5521feebff95
Aug 26 17:15:40 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:40 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eea91095-f4ab-4f77-89ed-5521feebff95" returned: 0 in 0.535s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eea91095-f4ab-4f77-89ed-5521feebff95 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:40 devstack sudo[107472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eea91095-f4ab-4f77-89ed-5521feebff95
Aug 26 17:15:40 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:40 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eea91095-f4ab-4f77-89ed-5521feebff95" returned: 0 in 0.302s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Lock "cinder-quobyte-eea91095-f4ab-4f77-89ed-5521feebff95" released by "delete_volume" :: held 0.898s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:40 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Created reservations ['341e3926-7721-477e-a3c6-d3a26f4cbf47', 'd206b0ba-6c32-4875-9566-fb0a76c6e249', '5f918ac2-8e64-412d-aedc-99e252943169', 'bc44370f-af04-47fa-832e-8331a0c36bc9'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:15:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:41 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:15:41 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:41 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.314s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:41 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:15:41 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Deleted volume successfully.
Aug 26 17:15:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ffe6c6d-4cc3-4338-997d-c5f6208b3b17 tempest-VolumesCloneNegativeTest-145626274 None] Lock "cinder-eea91095-f4ab-4f77-89ed-5521feebff95-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:15:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:42 devstack sudo[107478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:15:42 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:42 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.561s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:15:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:15:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 28 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:15:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:15:42 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a676ba15-ac24-4a88-9a2d-d0b5900f90d2 tempest-GroupsV320Test-1557535041 None] Group tempest-GroupsV320Test-Group-2075703405: creating
Aug 26 17:15:42 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a676ba15-ac24-4a88-9a2d-d0b5900f90d2 tempest-GroupsV320Test-1557535041 None] Group tempest-GroupsV320Test-Group-2075703405: created successfully
Aug 26 17:15:42 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a676ba15-ac24-4a88-9a2d-d0b5900f90d2 tempest-GroupsV320Test-1557535041 None] Create group completed successfully.
Aug 26 17:15:44 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-5ba420c7-dae0-47e1-a1af-357d83f11c35 tempest-GroupsV320Test-1557535041 None] Created reservations ['f2e4bad1-d881-44b1-bc9c-c56eb54853d3'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:15:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5ba420c7-dae0-47e1-a1af-357d83f11c35 tempest-GroupsV320Test-1557535041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5ba420c7-dae0-47e1-a1af-357d83f11c35 tempest-GroupsV320Test-1557535041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5ba420c7-dae0-47e1-a1af-357d83f11c35 tempest-GroupsV320Test-1557535041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5ba420c7-dae0-47e1-a1af-357d83f11c35 tempest-GroupsV320Test-1557535041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5ba420c7-dae0-47e1-a1af-357d83f11c35 tempest-GroupsV320Test-1557535041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5ba420c7-dae0-47e1-a1af-357d83f11c35 tempest-GroupsV320Test-1557535041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:44 devstack sudo[107481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:15:44 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:45 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5ba420c7-dae0-47e1-a1af-357d83f11c35 tempest-GroupsV320Test-1557535041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.381s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-5ba420c7-dae0-47e1-a1af-357d83f11c35 tempest-GroupsV320Test-1557535041 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:15:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5ba420c7-dae0-47e1-a1af-357d83f11c35 tempest-GroupsV320Test-1557535041 None] Delete group completed successfully.
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (e394c9d2-7da0-4978-ac57-4de647206ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72496b26-8152-44e6-a800-eb7f7a4df446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72496b26-8152-44e6-a800-eb7f7a4df446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1939067793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1620f24-2a7e-416c-96f1-4fdeedd8b638,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:45Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d4b139-cc6c-430b-ac0b-e8a37536c335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d4b139-cc6c-430b-ac0b-e8a37536c335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd6477b-647d-4034-affc-fb21cf22f228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd6477b-647d-4034-affc-fb21cf22f228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1620f24-2a7e-416c-96f1-4fdeedd8b638', 'volume_name': 'volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f209d7cd-afcd-42cc-98f9-38002dcb0df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f209d7cd-afcd-42cc-98f9-38002dcb0df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6ef38a-4562-48e4-91fb-dbc4bec2d15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:45 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Volume b1620f24-2a7e-416c-96f1-4fdeedd8b638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638', 'volume_size': 1}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1939067793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1620f24-2a7e-416c-96f1-4fdeedd8b638,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:45Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Creating volume b1620f24-2a7e-416c-96f1-4fdeedd8b638 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:15:45 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:15:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:45 devstack sudo[107485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638 1073741824
Aug 26 17:15:45 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:46 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638 1073741824" returned: 0 in 0.663s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:46 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638
Aug 26 17:15:46 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:46 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638" returned: 0 in 0.343s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:15:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6ef38a-4562-48e4-91fb-dbc4bec2d15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0292b7d8-4d00-47b3-9250-5d5a7c7ac549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:46 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Volume volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638 (b1620f24-2a7e-416c-96f1-4fdeedd8b638): created successfully
Aug 26 17:15:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0292b7d8-4d00-47b3-9250-5d5a7c7ac549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (e394c9d2-7da0-4978-ac57-4de647206ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-772490ed-e791-4ac1-9c0f-fc41edbcdf90 tempest-VolumesGetTest-1698814541 None] Created volume successfully.
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (ae05a771-b316-461c-b388-9e215118a8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94b2e54-683e-4abf-8fb0-5dfbf11c4843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94b2e54-683e-4abf-8fb0-5dfbf11c4843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1193229647',display_name='tempest-VolumesGetTest-Volume-450058209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6850d68-3632-46eb-90fb-cbff144a09e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:49Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2944e8-2d25-4bad-88e2-16c6bb653064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2944e8-2d25-4bad-88e2-16c6bb653064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3296d3ac-39cd-4015-8fd7-df2cacea3167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3296d3ac-39cd-4015-8fd7-df2cacea3167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6850d68-3632-46eb-90fb-cbff144a09e0', 'volume_name': 'volume-f6850d68-3632-46eb-90fb-cbff144a09e0', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9960c68-39a4-46da-ab93-3a2a5dfd2435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9960c68-39a4-46da-ab93-3a2a5dfd2435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa01fb6-50e0-4e73-96e6-73b94e5481d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:48 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Volume f6850d68-3632-46eb-90fb-cbff144a09e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6850d68-3632-46eb-90fb-cbff144a09e0', 'volume_size': 1}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1193229647',display_name='tempest-VolumesGetTest-Volume-450058209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6850d68-3632-46eb-90fb-cbff144a09e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:49Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Creating volume f6850d68-3632-46eb-90fb-cbff144a09e0 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:15:48 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:15:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f6850d68-3632-46eb-90fb-cbff144a09e0 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:48 devstack sudo[107532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f6850d68-3632-46eb-90fb-cbff144a09e0 1073741824
Aug 26 17:15:48 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:49 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f6850d68-3632-46eb-90fb-cbff144a09e0 1073741824" returned: 0 in 0.706s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f6850d68-3632-46eb-90fb-cbff144a09e0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:49 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f6850d68-3632-46eb-90fb-cbff144a09e0
Aug 26 17:15:49 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:49 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f6850d68-3632-46eb-90fb-cbff144a09e0" returned: 0 in 0.341s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:15:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa01fb6-50e0-4e73-96e6-73b94e5481d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6850d68-3632-46eb-90fb-cbff144a09e0', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1d1d95-2d1e-4841-8ea0-19ba915577f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:49 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Volume volume-f6850d68-3632-46eb-90fb-cbff144a09e0 (f6850d68-3632-46eb-90fb-cbff144a09e0): created successfully
Aug 26 17:15:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1d1d95-2d1e-4841-8ea0-19ba915577f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (ae05a771-b316-461c-b388-9e215118a8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:49 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-11754f73-f42d-475f-aa93-e262b1cf45d1 tempest-VolumesGetTest-1698814541 None] Created volume successfully.
Aug 26 17:15:50 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-f6850d68-3632-46eb-90fb-cbff144a09e0-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:50 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Lock "cinder-f6850d68-3632-46eb-90fb-cbff144a09e0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-quobyte-f6850d68-3632-46eb-90fb-cbff144a09e0" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-f6850d68-3632-46eb-90fb-cbff144a09e0" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9edbc06-c4ce-49a8-9bb1-60cd3067b60d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f6850d68-3632-46eb-90fb-cbff144a09e0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:51 devstack sudo[107540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f6850d68-3632-46eb-90fb-cbff144a09e0
Aug 26 17:15:51 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:51 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f6850d68-3632-46eb-90fb-cbff144a09e0" returned: 0 in 0.407s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f6850d68-3632-46eb-90fb-cbff144a09e0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:51 devstack sudo[107545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f6850d68-3632-46eb-90fb-cbff144a09e0
Aug 26 17:15:51 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:51 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f6850d68-3632-46eb-90fb-cbff144a09e0" returned: 0 in 0.278s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-f6850d68-3632-46eb-90fb-cbff144a09e0" released by "delete_volume" :: held 0.739s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Created reservations ['a1702223-cf6a-4483-bf04-b31cecca97be', '96c6595c-cbef-47b4-b7fa-2a128d5537c8', '2fe41580-05cd-4305-8116-16b66082418c', '39cf5b90-3297-4bd7-898c-3a5a61ac5d60'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:51 devstack sudo[107548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:15:51 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-b1620f24-2a7e-416c-96f1-4fdeedd8b638-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Lock "cinder-b1620f24-2a7e-416c-96f1-4fdeedd8b638-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-quobyte-b1620f24-2a7e-416c-96f1-4fdeedd8b638" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:15:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-b1620f24-2a7e-416c-96f1-4fdeedd8b638" acquired by "delete_volume" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:15:52 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:52 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e030c55e-43eb-4682-a236-bada9ed1ce59]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.473s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:52 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:15:52 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Deleted volume successfully.
Aug 26 17:15:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-bba37114-55c5-40d1-8963-ff1b37df5bb1 tempest-VolumesGetTest-1698814541 None] Lock "cinder-f6850d68-3632-46eb-90fb-cbff144a09e0-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:52 devstack sudo[107551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638
Aug 26 17:15:52 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:52 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638" returned: 0 in 0.502s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:52 devstack sudo[107556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638
Aug 26 17:15:52 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:53 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b1620f24-2a7e-416c-96f1-4fdeedd8b638" returned: 0 in 0.275s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-b1620f24-2a7e-416c-96f1-4fdeedd8b638" released by "delete_volume" :: held 0.834s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:53 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Created reservations ['0c87341c-80ed-4da4-9c06-11223fd085cb', '1836edbd-1cdf-4c1b-a3ef-15d99dac2c14', '167b98c0-8f9c-4363-821b-b70312ed7c13', '9ed36c41-aeba-4ea7-bb1c-a70de9420f1b'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:15:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:53 devstack sudo[107559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:15:53 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:53 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.279s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:53 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:15:53 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Deleted volume successfully.
Aug 26 17:15:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eac409bd-e6cb-46ef-b534-4ec1445b8186 tempest-VolumesGetTest-1698814541 None] Lock "cinder-b1620f24-2a7e-416c-96f1-4fdeedd8b638-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (86f10270-f663-481c-a6c6-a8fb9096376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214ee098-c012-407c-8286-ee38784c6fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214ee098-c012-407c-8286-ee38784c6fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-434883611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:54Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c71306-6804-410a-9375-1b16ebdc2aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c71306-6804-410a-9375-1b16ebdc2aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ff3129-8351-495e-807c-a0ff80814738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ff3129-8351-495e-807c-a0ff80814738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2', 'volume_name': 'volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0733c4-5803-4657-b153-386d27f8d826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0733c4-5803-4657-b153-386d27f8d826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63283e7c-3328-416c-9670-a7a9bd164f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:54 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Volume 2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2', 'volume_size': 1}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-434883611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:54Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Creating volume 2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:15:54 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:54 devstack sudo[107562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 1073741824
Aug 26 17:15:54 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:54 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 1073741824" returned: 0 in 0.637s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:54 devstack sudo[107569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2
Aug 26 17:15:54 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:55 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2" returned: 0 in 0.299s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:15:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:15:55 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63283e7c-3328-416c-9670-a7a9bd164f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:55 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6208a607-e318-4459-8f08-f890410ba69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:55 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Volume volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 (2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2): created successfully
Aug 26 17:15:55 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6208a607-e318-4459-8f08-f890410ba69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:55 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (86f10270-f663-481c-a6c6-a8fb9096376e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:55 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-95e0c29e-8f02-4b19-9f62-bc5a809b8f87 tempest-VolumesGetTest-1698814541 None] Created volume successfully.
Aug 26 17:15:56 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (cfb997d9-49a3-46d0-9535-ee65125e9c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6debeb1-a117-4e65-802c-ea03bf7958fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6debeb1-a117-4e65-802c-ea03bf7958fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-156683835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc6901e-85bd-443f-bd41-5f25a10bb7bd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2,status='creating',terminated_at=None,updated_at=2026-08-26T15:15:57Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d65f52-98d7-47f4-9c53-7185ea2e427a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d65f52-98d7-47f4-9c53-7185ea2e427a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1b473f-d0ca-459d-8c45-fc98070c4c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1b473f-d0ca-459d-8c45-fc98070c4c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3fc6901e-85bd-443f-bd41-5f25a10bb7bd', 'volume_name': 'volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd', 'volume_size': 1, 'source_volid': '2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2', 'source_volstatus': 'available'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8ceb13-683d-4653-8571-93c66801ea9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8ceb13-683d-4653-8571-93c66801ea9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b95344-342d-4eee-b953-efc94a3e371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:15:57 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Volume 3fc6901e-85bd-443f-bd41-5f25a10bb7bd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd', 'volume_size': 1, 'source_volid': '2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2', 'source_volstatus': 'available'}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:15:57 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Cloning volume 2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 to volume 3fc6901e-85bd-443f-bd41-5f25a10bb7bd
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Creating offline snapshot 1a774563-7f04-4b7d-b351-135ae39e7aaf of volume 2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[df737306-ee52-4f81-8cfd-99a7cd898158]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:15:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:57 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2
Aug 26 17:15:57 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:58 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2" returned: 0 in 0.841s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:58 devstack sudo[107593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf 1G
Aug 26 17:15:58 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:58 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf 1G" returned: 0 in 0.596s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:58 devstack sudo[107606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf
Aug 26 17:15:58 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:59 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf" returned: 0 in 0.405s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:59 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf is being set with open permissions: ugo+rw
Aug 26 17:15:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:59 devstack sudo[107611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf
Aug 26 17:15:59 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:59 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf" returned: 0 in 0.291s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:59 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.info
Aug 26 17:15:59 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:15:59 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Aug 26 17:15:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.info" returned: 0 in 0.320s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:15:59 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.info is being set with open permissions: ugo+rw
Aug 26 17:15:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:15:59 devstack sudo[107617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.info
Aug 26 17:15:59 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:00 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.info" returned: 0 in 0.326s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-quobyte-3fc6901e-85bd-443f-bd41-5f25a10bb7bd" by "_copy_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-3fc6901e-85bd-443f-bd41-5f25a10bb7bd" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] snapshot: 1a774563-7f04-4b7d-b351-135ae39e7aaf, volume: 3fc6901e-85bd-443f-bd41-5f25a10bb7bd,  {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3759e2eb-9004-461d-97db-bb69c1da735d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:00 devstack sudo[107620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf
Aug 26 17:16:00 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:00 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf" returned: 0 in 0.469s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9e5f75-bf74-4750-8bd1-8d6ff0041734]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:00 devstack sudo[107625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2
Aug 26 17:16:00 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:01 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2" returned: 0 in 0.488s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 26 17:16:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Creating direct copy from snapshot {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 26 17:16:01 devstack cinder-volume[94125]: DEBUG cinder.utils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Path /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd not found in is_blk_device check {{(pid=94125) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 26 17:16:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:01 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd
Aug 26 17:16:01 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:01 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=100,cinder:INSERT=28,cinder:UPDATE=108,cinder:DELETE=8 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:16:02 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=96,cinder:UPDATE=105,cinder:INSERT=34,cinder:DELETE=7 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:16:02 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-45aadc73-8917-44fb-861f-b1e077a91711 req-5208b00f-671c-4bc8-a091-b3d16121df71 tempest-TestShelveInstance-1648727836 None] Terminate volume connection completed successfully.
Aug 26 17:16:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-45aadc73-8917-44fb-861f-b1e077a91711 req-5208b00f-671c-4bc8-a091-b3d16121df71 tempest-TestShelveInstance-1648727836 None] Deleting attachment 5ae1ccd2-fe68-4c92-94ff-a6d709acf4ae. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:16:07 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd" returned: 0 in 6.615s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:07 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:16:07 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Converted 1024.00 MB image at 154.76 MB/s
Aug 26 17:16:07 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd is being set with open permissions: ugo+rw
Aug 26 17:16:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:07 devstack sudo[107669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd
Aug 26 17:16:07 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:08 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd" returned: 0 in 0.411s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-3fc6901e-85bd-443f-bd41-5f25a10bb7bd" released by "_copy_volume_from_snapshot" :: held 8.081s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-quobyte-1a774563-7f04-4b7d-b351-135ae39e7aaf" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-1a774563-7f04-4b7d-b351-135ae39e7aaf" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Deleting offline snapshot 1a774563-7f04-4b7d-b351-135ae39e7aaf of volume 2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] snapshot_file for this snap is: volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb19429f-1ab7-471b-8a59-6d11a3f56f1a]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:08 devstack sudo[107679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf
Aug 26 17:16:08 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-a56aeb88-0485-4fcc-800c-1acea4c739a3 req-cfc52ab9-1ff8-41df-86fe-8b6dde674d94 tempest-TestShelveInstance-1648727836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:08 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf" returned: 0 in 0.487s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[59816cb2-d318-4274-90c9-bfa09db9af29]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:08 devstack sudo[107685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2
Aug 26 17:16:08 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:09 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2" returned: 0 in 0.657s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:09 devstack sudo[107691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf
Aug 26 17:16:09 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:10 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf" returned: 0 in 0.524s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:10 devstack sudo[107696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf
Aug 26 17:16:10 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:10 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2.1a774563-7f04-4b7d-b351-135ae39e7aaf" returned: 0 in 0.369s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-1a774563-7f04-4b7d-b351-135ae39e7aaf" released by "_delete_snapshot" :: held 2.189s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.322s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-a56aeb88-0485-4fcc-800c-1acea4c739a3 req-cfc52ab9-1ff8-41df-86fe-8b6dde674d94 tempest-TestShelveInstance-1648727836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.950s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-a56aeb88-0485-4fcc-800c-1acea4c739a3 req-cfc52ab9-1ff8-41df-86fe-8b6dde674d94 tempest-TestShelveInstance-1648727836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b95344-342d-4eee-b953-efc94a3e371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd', 'volume_size': 1, 'source_volid': '2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2', 'source_volstatus': 'available'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1624c41b-0e14-42f9-87ae-9961506cb2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:10 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Volume volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd (3fc6901e-85bd-443f-bd41-5f25a10bb7bd): created successfully
Aug 26 17:16:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1624c41b-0e14-42f9-87ae-9961506cb2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (cfb997d9-49a3-46d0-9535-ee65125e9c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-a56aeb88-0485-4fcc-800c-1acea4c739a3 req-cfc52ab9-1ff8-41df-86fe-8b6dde674d94 tempest-TestShelveInstance-1648727836 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-ce02064f-7014-461c-977e-a64793509d30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53c67bb0-1479-4fec-bfce-5586e282da4a', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:16:10 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-01d4e098-d491-40e5-adc9-557042a9f1f2 tempest-VolumesGetTest-1698814541 None] Created volume successfully.
Aug 26 17:16:10 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-a56aeb88-0485-4fcc-800c-1acea4c739a3 req-cfc52ab9-1ff8-41df-86fe-8b6dde674d94 tempest-TestShelveInstance-1648727836 None] attachment_update completed successfully.
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (9f0f2523-cecb-4742-958a-f77058ca3fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4067d1f0-6954-4d71-9a7b-4279573a9390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4067d1f0-6954-4d71-9a7b-4279573a9390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1626259647',display_name='tempest-VolumesGetTest-Volume-1706732711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3aa1ba-6645-44d7-9c06-87945ccd3ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:12Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f72165-348f-4544-8729-5fd7cb17f43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f72165-348f-4544-8729-5fd7cb17f43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e38ffe2-16c1-4c12-8f34-49586ec57f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e38ffe2-16c1-4c12-8f34-49586ec57f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3aa1ba-6645-44d7-9c06-87945ccd3ae1', 'volume_name': 'volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8918e1c8-cb66-410b-aa4f-46dece60fd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8918e1c8-cb66-410b-aa4f-46dece60fd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ccc8ec-76f1-4721-993b-02ed52a16b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Volume ed3aa1ba-6645-44d7-9c06-87945ccd3ae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1', 'volume_size': 1}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1626259647',display_name='tempest-VolumesGetTest-Volume-1706732711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3aa1ba-6645-44d7-9c06-87945ccd3ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:12Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Creating volume ed3aa1ba-6645-44d7-9c06-87945ccd3ae1 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:16:12 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:16:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:12 devstack sudo[107699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1 1073741824
Aug 26 17:16:12 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:13 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1 1073741824" returned: 0 in 0.641s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:13 devstack sudo[107705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1
Aug 26 17:16:13 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:13 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1" returned: 0 in 0.350s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:16:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ccc8ec-76f1-4721-993b-02ed52a16b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76dbb1fa-47ce-4232-875c-95e3c9ca335e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:13 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Volume volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1 (ed3aa1ba-6645-44d7-9c06-87945ccd3ae1): created successfully
Aug 26 17:16:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76dbb1fa-47ce-4232-875c-95e3c9ca335e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (9f0f2523-cecb-4742-958a-f77058ca3fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:13 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0cf44d79-b437-49b6-beb6-f0e826275c4a tempest-VolumesGetTest-1698814541 None] Created volume successfully.
Aug 26 17:16:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Lock "cinder-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-quobyte-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:15 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[703a3321-011c-4a6e-b773-f15a7bd23239]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:15 devstack sudo[108125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1
Aug 26 17:16:15 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:15 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1" returned: 0 in 0.576s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:15 devstack sudo[108151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1
Aug 26 17:16:15 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:16 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1" returned: 0 in 0.330s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1" released by "delete_volume" :: held 0.970s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:16 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Created reservations ['9188b35f-541f-4f24-ac35-e98fd3deab07', '61841fbe-8e9b-42dd-b08a-45e087735ab4', 'a6b4a073-0cca-4d36-8a5a-9b3ac2391d9b', '189d5b84-0f25-4f65-a3c9-b383e91d5aad'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:16:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:16 devstack sudo[108167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:16:16 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:16 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.286s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:16 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:16:16 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Deleted volume successfully.
Aug 26 17:16:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5fe12f8-2dd5-48e1-be13-9fff41dc1e77 tempest-VolumesGetTest-1698814541 None] Lock "cinder-ed3aa1ba-6645-44d7-9c06-87945ccd3ae1-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-3fc6901e-85bd-443f-bd41-5f25a10bb7bd-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Lock "cinder-3fc6901e-85bd-443f-bd41-5f25a10bb7bd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-quobyte-3fc6901e-85bd-443f-bd41-5f25a10bb7bd" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-3fc6901e-85bd-443f-bd41-5f25a10bb7bd" acquired by "delete_volume" :: waited 0.034s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:17 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[0738b822-5d11-4671-8009-b12cee489637]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:17 devstack sudo[108180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd
Aug 26 17:16:17 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:18 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd" returned: 0 in 0.601s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:18 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd
Aug 26 17:16:18 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:18 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3fc6901e-85bd-443f-bd41-5f25a10bb7bd" returned: 0 in 0.556s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-3fc6901e-85bd-443f-bd41-5f25a10bb7bd" released by "delete_volume" :: held 1.239s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:18 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Created reservations ['69ed7e68-74cb-49d0-af3e-0f69b0492599', 'c4fe1258-c909-403a-9ab1-4ba9b447d3ae', '17624031-2a7c-46a1-b7cb-ed70a7e141eb', '6defe04f-1d10-474b-a8a4-a941270a675c'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:16:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:19 devstack sudo[108192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:16:19 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:19 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.479s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:19 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:16:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Deleted volume successfully.
Aug 26 17:16:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-65b3205a-4818-415a-bf89-105df57686a7 tempest-VolumesGetTest-1698814541 None] Lock "cinder-3fc6901e-85bd-443f-bd41-5f25a10bb7bd-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Lock "cinder-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-quobyte-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2" acquired by "delete_volume" :: waited 0.037s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:20 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dd2dcc-18be-4c0b-afd2-2a781a111bcf]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:20 devstack sudo[108229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2
Aug 26 17:16:20 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:20 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2" returned: 0 in 0.600s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:20 devstack sudo[108236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2
Aug 26 17:16:20 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:21 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2" returned: 0 in 0.323s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2" released by "delete_volume" :: held 1.019s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:21 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Created reservations ['2fc69812-ee3c-440c-9efb-264b6953d145', 'a9652e5a-a03a-40db-9482-fe41ae87c06f', '7b1a09d5-aed7-4b66-bfc2-bf40fed4c2c6', '82be2e4d-c38f-48c6-b03b-d97ca33ff721'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:16:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:21 devstack sudo[108239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:16:21 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:21 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.344s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:21 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:16:21 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Deleted volume successfully.
Aug 26 17:16:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-90d03b40-8d49-4ab8-9188-5e9da4b07fe9 tempest-VolumesGetTest-1698814541 None] Lock "cinder-2fd6aec8-203e-4ddd-ad0c-2d3fb4c823b2-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:23 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:16:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (0ae407df-2133-46ca-80e0-4b3d590d47c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a08c6a-d99e-44f3-b39f-d6d01daa0327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a08c6a-d99e-44f3-b39f-d6d01daa0327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2001166855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2c9b54-e714-444d-b9be-3a605566f2cd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:24Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c359ab8-048e-4876-9d84-1e5acab34d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c359ab8-048e-4876-9d84-1e5acab34d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a27c823-a1fc-462e-86ff-219371fdb482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:23 devstack cinder-volume[94125]: DEBUG cinder.image.glance [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Creating Keystone auth plugin from conf {{(pid=94125) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 17:16:24 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a27c823-a1fc-462e-86ff-219371fdb482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a2c9b54-e714-444d-b9be-3a605566f2cd', 'volume_name': 'volume-3a2c9b54-e714-444d-b9be-3a605566f2cd', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd09c590>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:24 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec37773-8dc2-456d-9f7c-fcd4335a72af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:24 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec37773-8dc2-456d-9f7c-fcd4335a72af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:24 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a0c5ce-f45e-45b3-8fec-30c9b7afc981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:24 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Volume 3a2c9b54-e714-444d-b9be-3a605566f2cd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a2c9b54-e714-444d-b9be-3a605566f2cd', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd09c590>}
Aug 26 17:16:24 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Trying to clone 3a2c9b54-e714-444d-b9be-3a605566f2cd from image b24297bc-5b4d-44da-a168-9014960429c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]). {{(pid=94125) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 17:16:25 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 17:16:25 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Image download 20.69 MB at 20.69 MB/s
Aug 26 17:16:25 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78aaaeb-8c19-4143-8830-583f6605d005]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:25 devstack sudo[108246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD
Aug 26 17:16:25 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:25 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD" returned: 0 in 0.661s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:25 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Temporary image b24297bc-5b4d-44da-a168-9014960429c1 is fetched for user 8e694fe992f148b9812f594678ee1b2b. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 17:16:25 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[84608254-362e-4520-aa62-6f212fef5955]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:26 devstack sudo[108262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD
Aug 26 17:16:26 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:26 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD" returned: 0 in 0.485s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2001166855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2c9b54-e714-444d-b9be-3a605566f2cd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:24Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:16:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Creating volume 3a2c9b54-e714-444d-b9be-3a605566f2cd {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:16:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:16:26 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:16:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:26 devstack sudo[108274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd 1073741824
Aug 26 17:16:26 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:27 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd 1073741824" returned: 0 in 0.769s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:27 devstack sudo[108280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd
Aug 26 17:16:27 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:27 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd" returned: 0 in 0.349s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:16:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:27 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Attempting download of b24297bc-5b4d-44da-a168-9014960429c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}])) to volume 3a2c9b54-e714-444d-b9be-3a605566f2cd. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 17:16:27 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[6312eb93-ed32-4d9e-9f43-22f954666fad]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_g_hc2_e8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:28 devstack sudo[108283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_g_hc2_e8
Aug 26 17:16:28 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:28 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_g_hc2_e8" returned: 0 in 0.657s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_g_hc2_e8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:28 devstack sudo[108294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_g_hc2_e8
Aug 26 17:16:28 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:28 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_g_hc2_e8" returned: 1 in 0.467s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_g_hc2_e8' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:16:28 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f40f073-3714-4021-82ed-41357f6f693b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:29 devstack sudo[108298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD
Aug 26 17:16:29 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:29 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD" returned: 0 in 0.774s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:29 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] b24297bc-5b4d-44da-a168-9014960429c1 was qcow2, converting to qcow2 {{(pid=94125) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 17:16:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:29 devstack sudo[108336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd
Aug 26 17:16:29 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:32 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd" returned: 0 in 3.304s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:32 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_lgyo1z9_devstack@QuobyteHD, size 112.00 MB, duration 3.31 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:16:32 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Converted 112.00 MB image at 33.87 MB/s
Aug 26 17:16:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:33 devstack sudo[108397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd 1G
Aug 26 17:16:33 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Flow 'volume_create_manager' (9b099ec4-deb0-4743-b4b4-28a7e0a3a28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9314b4db-0a9d-43f2-bf0e-375aac76fdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:33 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd 1G" returned: 0 in 0.474s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Downloaded image b24297bc-5b4d-44da-a168-9014960429c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}])) to volume 3a2c9b54-e714-444d-b9be-3a605566f2cd successfully. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Temporary image b24297bc-5b4d-44da-a168-9014960429c1 for user 8e694fe992f148b9812f594678ee1b2b is deleted. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Marking volume 3a2c9b54-e714-444d-b9be-3a605566f2cd as bootable. {{(pid=94125) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9314b4db-0a9d-43f2-bf0e-375aac76fdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1226028537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b094e090-4315-43ae-9c2a-0a33a23273d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fe17a65a274ed4a71a1ffc831b68ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:33Z,use_quota=True,user_id='7d7040658f3e41d3af084c1cbcf22193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df6b0a8-3428-4adc-932f-27d4b3bfda7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df6b0a8-3428-4adc-932f-27d4b3bfda7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b18e43-8bce-4312-b7c0-a3e50f8ea2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b18e43-8bce-4312-b7c0-a3e50f8ea2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b094e090-4315-43ae-9c2a-0a33a23273d2', 'volume_name': 'volume-b094e090-4315-43ae-9c2a-0a33a23273d2', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980446a1-d707-4127-8e18-c2d406433497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980446a1-d707-4127-8e18-c2d406433497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05cc277b-750d-401a-9e44-6abf9bf033b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:33 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Volume b094e090-4315-43ae-9c2a-0a33a23273d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b094e090-4315-43ae-9c2a-0a33a23273d2', 'volume_size': 1}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1226028537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b094e090-4315-43ae-9c2a-0a33a23273d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fe17a65a274ed4a71a1ffc831b68ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:33Z,use_quota=True,user_id='7d7040658f3e41d3af084c1cbcf22193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Creating volume b094e090-4315-43ae-9c2a-0a33a23273d2 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:16:33 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b094e090-4315-43ae-9c2a-0a33a23273d2 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Copying metadata from image b24297bc-5b4d-44da-a168-9014960429c1 to 3a2c9b54-e714-444d-b9be-3a605566f2cd. {{(pid=94125) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Creating volume glance metadata for volume 3a2c9b54-e714-444d-b9be-3a605566f2cd backed by image b24297bc-5b4d-44da-a168-9014960429c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94125) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 17:16:33 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b094e090-4315-43ae-9c2a-0a33a23273d2 1073741824
Aug 26 17:16:33 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a0c5ce-f45e-45b3-8fec-30c9b7afc981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2c9b54-e714-444d-b9be-3a605566f2cd', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd09c590>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a47709-1eb0-4aa9-bdd7-61e78e263247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:33 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Volume volume-3a2c9b54-e714-444d-b9be-3a605566f2cd (3a2c9b54-e714-444d-b9be-3a605566f2cd): created successfully
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a47709-1eb0-4aa9-bdd7-61e78e263247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (0ae407df-2133-46ca-80e0-4b3d590d47c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5b1899f8-63f4-4741-9a15-a5c49380d9f1 tempest-VolumesGetTest-1698814541 None] Created volume successfully.
Aug 26 17:16:34 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b094e090-4315-43ae-9c2a-0a33a23273d2 1073741824" returned: 0 in 0.605s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b094e090-4315-43ae-9c2a-0a33a23273d2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:34 devstack sudo[108443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b094e090-4315-43ae-9c2a-0a33a23273d2
Aug 26 17:16:34 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:34 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b094e090-4315-43ae-9c2a-0a33a23273d2" returned: 0 in 0.318s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:16:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05cc277b-750d-401a-9e44-6abf9bf033b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b094e090-4315-43ae-9c2a-0a33a23273d2', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9daa94-2fc9-4027-907d-9d2ceedea7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:34 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Volume volume-b094e090-4315-43ae-9c2a-0a33a23273d2 (b094e090-4315-43ae-9c2a-0a33a23273d2): created successfully
Aug 26 17:16:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9daa94-2fc9-4027-907d-9d2ceedea7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Flow 'volume_create_manager' (9b099ec4-deb0-4743-b4b4-28a7e0a3a28e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:34 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4548252a-82ec-43d9-9c22-4c441621b09a tempest-VolumesListAdminTestJSON-1972998056 None] Created volume successfully.
Aug 26 17:16:35 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (4f3bec7d-5cc6-4689-a33d-6dbdfe2e8c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71532c4e-7f3f-4ab7-a5ab-5a292ec481d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71532c4e-7f3f-4ab7-a5ab-5a292ec481d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1073446210',display_name='tempest-VolumesGetTest-Volume-1262727951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de638c4e-2e20-4f9f-b73a-b5f08450fb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:36Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11c5dd3-043a-4705-ac1c-01b5ff04ba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11c5dd3-043a-4705-ac1c-01b5ff04ba15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424a8070-733a-4828-a1c4-2a7a0b168082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424a8070-733a-4828-a1c4-2a7a0b168082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de638c4e-2e20-4f9f-b73a-b5f08450fb53', 'volume_name': 'volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee374877-4e38-483f-a12f-bf4654107e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee374877-4e38-483f-a12f-bf4654107e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6d1da2-87b2-4c60-a8bf-0f278b72830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:36 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Volume de638c4e-2e20-4f9f-b73a-b5f08450fb53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53', 'volume_size': 1}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1073446210',display_name='tempest-VolumesGetTest-Volume-1262727951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de638c4e-2e20-4f9f-b73a-b5f08450fb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23e151ba2c84b33a65e163cbd9630bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:36Z,use_quota=True,user_id='8e694fe992f148b9812f594678ee1b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Creating volume de638c4e-2e20-4f9f-b73a-b5f08450fb53 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:16:36 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:36 devstack sudo[108450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53 1073741824
Aug 26 17:16:36 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Flow 'volume_create_manager' (73eee4dc-3e1b-4fe6-a5ce-2399aa669a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ad3886-0221-42ab-8b77-b1a0a4c9f145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ad3886-0221-42ab-8b77-b1a0a4c9f145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1647272828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd0ba8f-95d1-469e-ba1a-70648aa2fadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fe17a65a274ed4a71a1ffc831b68ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:36Z,use_quota=True,user_id='7d7040658f3e41d3af084c1cbcf22193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef497900-fe52-456e-b176-94c6f9300e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef497900-fe52-456e-b176-94c6f9300e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2079ab02-5b2f-468d-9b6d-87af74d4092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2079ab02-5b2f-468d-9b6d-87af74d4092b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdd0ba8f-95d1-469e-ba1a-70648aa2fadb', 'volume_name': 'volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f9fbb4-6c27-4ba1-bc8b-07025932c708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f9fbb4-6c27-4ba1-bc8b-07025932c708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a291e55e-a389-4516-a1b4-4c3effba0ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:36 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Volume bdd0ba8f-95d1-469e-ba1a-70648aa2fadb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb', 'volume_size': 1}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:36 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53 1073741824" returned: 0 in 0.491s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:36 devstack sudo[108456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53
Aug 26 17:16:36 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:36 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53" returned: 0 in 0.269s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.513s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1647272828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd0ba8f-95d1-469e-ba1a-70648aa2fadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fe17a65a274ed4a71a1ffc831b68ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:36Z,use_quota=True,user_id='7d7040658f3e41d3af084c1cbcf22193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Creating volume bdd0ba8f-95d1-469e-ba1a-70648aa2fadb {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:16:36 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6d1da2-87b2-4c60-a8bf-0f278b72830d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12935509-7e7b-46f5-8ca6-60f6dbe2cef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:36 devstack sudo[108459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb 1073741824
Aug 26 17:16:36 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:36 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Volume volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53 (de638c4e-2e20-4f9f-b73a-b5f08450fb53): created successfully
Aug 26 17:16:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12935509-7e7b-46f5-8ca6-60f6dbe2cef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Flow 'volume_create_manager' (4f3bec7d-5cc6-4689-a33d-6dbdfe2e8c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0508c4cb-d557-43d3-adf8-f2116a1f69c5 tempest-VolumesGetTest-1698814541 None] Created volume successfully.
Aug 26 17:16:37 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb 1073741824" returned: 0 in 0.420s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:37 devstack sudo[108464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb
Aug 26 17:16:37 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:37 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb" returned: 0 in 0.258s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:16:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a291e55e-a389-4516-a1b4-4c3effba0ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a1d7a2-805a-4edb-bdf8-0bab7b4018c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:37 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Volume volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb (bdd0ba8f-95d1-469e-ba1a-70648aa2fadb): created successfully
Aug 26 17:16:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a1d7a2-805a-4edb-bdf8-0bab7b4018c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Flow 'volume_create_manager' (73eee4dc-3e1b-4fe6-a5ce-2399aa669a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f3039a48-4f35-45bc-b962-b475d562b1ba tempest-VolumesListAdminTestJSON-1972998056 None] Created volume successfully.
Aug 26 17:16:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-de638c4e-2e20-4f9f-b73a-b5f08450fb53-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Lock "cinder-de638c4e-2e20-4f9f-b73a-b5f08450fb53-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-quobyte-de638c4e-2e20-4f9f-b73a-b5f08450fb53" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-de638c4e-2e20-4f9f-b73a-b5f08450fb53" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:38 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f714671-8fa3-486a-8c04-fcecb08f1f5d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:38 devstack sudo[108467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53
Aug 26 17:16:38 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:38 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53" returned: 0 in 0.407s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:38 devstack sudo[108473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53
Aug 26 17:16:38 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:38 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-de638c4e-2e20-4f9f-b73a-b5f08450fb53" returned: 0 in 0.322s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:38 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Flow 'volume_create_manager' (eb27951e-36ab-4faa-9f67-f73ccc6a998b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e874fb-09e5-4264-87e2-42028eb11f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-de638c4e-2e20-4f9f-b73a-b5f08450fb53" released by "delete_volume" :: held 0.846s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e874fb-09e5-4264-87e2-42028eb11f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1338100337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e7756c-3fb9-4de2-81cc-9411e11c5053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fe17a65a274ed4a71a1ffc831b68ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:39Z,use_quota=True,user_id='7d7040658f3e41d3af084c1cbcf22193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0511488e-c9ad-4a7d-bb08-fd8cd90987d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0511488e-c9ad-4a7d-bb08-fd8cd90987d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e8d723-94ff-4f2f-a00a-07775e5e70e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e8d723-94ff-4f2f-a00a-07775e5e70e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e7756c-3fb9-4de2-81cc-9411e11c5053', 'volume_name': 'volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441843d1-11e8-4047-84e3-684fe82056c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441843d1-11e8-4047-84e3-684fe82056c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113b49b0-7300-47d7-a2bb-74847608090c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:39 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Volume a9e7756c-3fb9-4de2-81cc-9411e11c5053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053', 'volume_size': 1}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1338100337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e7756c-3fb9-4de2-81cc-9411e11c5053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fe17a65a274ed4a71a1ffc831b68ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:39Z,use_quota=True,user_id='7d7040658f3e41d3af084c1cbcf22193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Creating volume a9e7756c-3fb9-4de2-81cc-9411e11c5053 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:16:39 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:39 devstack sudo[108478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053 1073741824
Aug 26 17:16:39 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Created reservations ['87bf43c0-9a82-4b4e-880e-6de31d326957', 'cb7eb3f2-9e48-46e8-95d3-3f1e4b8e84f2', '10a6854c-0fb4-496c-9cd2-e36a31e40db4', '18da445d-2fdd-4c6d-93fc-0c967e085f38'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:39 devstack sudo[108480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:16:39 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-3a2c9b54-e714-444d-b9be-3a605566f2cd-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Lock "cinder-3a2c9b54-e714-444d-b9be-3a605566f2cd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Acquiring lock "cinder-quobyte-3a2c9b54-e714-444d-b9be-3a605566f2cd" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-3a2c9b54-e714-444d-b9be-3a605566f2cd" acquired by "delete_volume" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:39 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.450s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:16:39 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[14468d1d-b8ca-4d39-8c57-79fdc57ba5fb]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:39 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Deleted volume successfully.
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053 1073741824" returned: 0 in 0.633s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-91c29958-a89a-445b-b359-19d7d60c8027 tempest-VolumesGetTest-1698814541 None] Lock "cinder-de638c4e-2e20-4f9f-b73a-b5f08450fb53-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:39 devstack sudo[108487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053
Aug 26 17:16:39 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:39 devstack sudo[108486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd
Aug 26 17:16:39 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:40 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053" returned: 0 in 0.332s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113b49b0-7300-47d7-a2bb-74847608090c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215687b9-4461-435a-acda-3beef8e5c469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:40 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Volume volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053 (a9e7756c-3fb9-4de2-81cc-9411e11c5053): created successfully
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215687b9-4461-435a-acda-3beef8e5c469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Flow 'volume_create_manager' (eb27951e-36ab-4faa-9f67-f73ccc6a998b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:40 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f2d75853-237f-460f-82ee-8fed7b221e61 tempest-VolumesListAdminTestJSON-1972998056 None] Created volume successfully.
Aug 26 17:16:40 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd" returned: 0 in 0.490s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:40 devstack sudo[108494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd
Aug 26 17:16:40 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:40 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3a2c9b54-e714-444d-b9be-3a605566f2cd" returned: 0 in 0.300s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Lock "cinder-quobyte-3a2c9b54-e714-444d-b9be-3a605566f2cd" released by "delete_volume" :: held 0.865s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Created reservations ['73edb331-b1ad-47df-beae-78c65796243b', '79284a3b-a8f2-459e-836f-4b21c297c027', '768781b4-167c-4574-a6ac-d1621cf66bc0', '4cc91fd4-5df8-4271-8295-3ef9804dc957'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:40 devstack sudo[108497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:16:40 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:41 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.361s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:41 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:16:41 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Deleted volume successfully.
Aug 26 17:16:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d42d33b-d1f5-4c51-8765-f6054485d1cf tempest-VolumesGetTest-1698814541 None] Lock "cinder-3a2c9b54-e714-444d-b9be-3a605566f2cd-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:42 devstack sudo[108500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:16:42 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Flow 'volume_create_manager' (7c053ba6-cb34-4912-b7cc-fe64ee7da289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5830894-bb13-4ee1-b74c-69eced5acbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5830894-bb13-4ee1-b74c-69eced5acbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c972608-84d9-4557-99f6-41596d49f9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb077adb90a4efea73549e480b83e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:42Z,use_quota=True,user_id='cb66b3b276e44fa386d54237d40fa784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf98065-f61d-4c67-b6df-0eb558cab113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf98065-f61d-4c67-b6df-0eb558cab113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca37522-4e31-4ba6-b65b-52ae3f65ee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca37522-4e31-4ba6-b65b-52ae3f65ee9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c972608-84d9-4557-99f6-41596d49f9e7', 'volume_name': 'volume-0c972608-84d9-4557-99f6-41596d49f9e7', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fca8fd-bb11-423c-ab7b-d107ad37f819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fca8fd-bb11-423c-ab7b-d107ad37f819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af673142-32c7-45d5-a3b5-216c88a4f7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:42 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Volume 0c972608-84d9-4557-99f6-41596d49f9e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c972608-84d9-4557-99f6-41596d49f9e7', 'volume_size': 1}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c972608-84d9-4557-99f6-41596d49f9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb077adb90a4efea73549e480b83e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:42Z,use_quota=True,user_id='cb66b3b276e44fa386d54237d40fa784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Creating volume 0c972608-84d9-4557-99f6-41596d49f9e7 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:16:42 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0c972608-84d9-4557-99f6-41596d49f9e7 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:42 devstack sudo[108502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0c972608-84d9-4557-99f6-41596d49f9e7 1073741824
Aug 26 17:16:42 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:42 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.368s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 28 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:16:42 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0c972608-84d9-4557-99f6-41596d49f9e7 1073741824" returned: 0 in 0.561s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0c972608-84d9-4557-99f6-41596d49f9e7 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:43 devstack sudo[108509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0c972608-84d9-4557-99f6-41596d49f9e7
Aug 26 17:16:43 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:43 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0c972608-84d9-4557-99f6-41596d49f9e7" returned: 0 in 0.299s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:16:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af673142-32c7-45d5-a3b5-216c88a4f7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c972608-84d9-4557-99f6-41596d49f9e7', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e104f2e-2507-4aa5-82e6-a0fd56b0ed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:43 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Volume volume-0c972608-84d9-4557-99f6-41596d49f9e7 (0c972608-84d9-4557-99f6-41596d49f9e7): created successfully
Aug 26 17:16:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e104f2e-2507-4aa5-82e6-a0fd56b0ed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Flow 'volume_create_manager' (7c053ba6-cb34-4912-b7cc-fe64ee7da289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:43 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a0c44b94-877b-4414-b31b-4d675f24d0b7 tempest-VolumesListAdminTestJSON-1677547012 None] Created volume successfully.
Aug 26 17:16:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Acquiring lock "cinder-0c972608-84d9-4557-99f6-41596d49f9e7-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Lock "cinder-0c972608-84d9-4557-99f6-41596d49f9e7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Acquiring lock "cinder-quobyte-0c972608-84d9-4557-99f6-41596d49f9e7" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Lock "cinder-quobyte-0c972608-84d9-4557-99f6-41596d49f9e7" acquired by "delete_volume" :: waited 0.037s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:44 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[1000ba4b-fb3a-401c-a94a-bbcf94f6e29f]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0c972608-84d9-4557-99f6-41596d49f9e7 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "cinder-a9e7756c-3fb9-4de2-81cc-9411e11c5053-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "cinder-a9e7756c-3fb9-4de2-81cc-9411e11c5053-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:44 devstack sudo[108512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0c972608-84d9-4557-99f6-41596d49f9e7
Aug 26 17:16:44 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "cinder-quobyte-a9e7756c-3fb9-4de2-81cc-9411e11c5053" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "cinder-quobyte-a9e7756c-3fb9-4de2-81cc-9411e11c5053" acquired by "delete_volume" :: waited 0.038s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:44 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb34b9c9-6bfb-48b6-8791-27ffedc0eb53]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:45 devstack sudo[108523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053
Aug 26 17:16:45 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:45 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0c972608-84d9-4557-99f6-41596d49f9e7" returned: 0 in 0.577s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0c972608-84d9-4557-99f6-41596d49f9e7 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:45 devstack sudo[108541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0c972608-84d9-4557-99f6-41596d49f9e7
Aug 26 17:16:45 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:45 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053" returned: 0 in 0.539s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:45 devstack sudo[108546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053
Aug 26 17:16:45 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:45 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0c972608-84d9-4557-99f6-41596d49f9e7" returned: 0 in 0.359s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Lock "cinder-quobyte-0c972608-84d9-4557-99f6-41596d49f9e7" released by "delete_volume" :: held 1.007s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Created reservations ['3113742d-20b9-44b4-ba69-7ddcc0dced7f', '9cb84ba6-c62d-4946-a066-3b4fde959cb1', 'dbf0fa27-6310-4976-8684-cf985269cd0b', '40e8728f-466d-44da-a841-2ef77cd9cb15'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:45 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a9e7756c-3fb9-4de2-81cc-9411e11c5053" returned: 0 in 0.328s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:45 devstack sudo[108550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:16:45 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "cinder-quobyte-a9e7756c-3fb9-4de2-81cc-9411e11c5053" released by "delete_volume" :: held 0.937s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Created reservations ['89fda792-cfbd-494e-afa9-d09a05585550', '7a1163d7-c5fd-4957-b074-e51ddc4444c3', '52e5b02a-cf69-4e76-9f47-19d86af251fe', 'b077b227-c77b-4701-8f07-449da6fec789'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:45 devstack sudo[108552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:16:45 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:46 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "cinder-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.330s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:16:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Deleted volume successfully.
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Lock "cinder-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-84de218f-c3eb-4d0a-b86c-01b815fca821 tempest-VolumesListAdminTestJSON-1677547012 None] Lock "cinder-0c972608-84d9-4557-99f6-41596d49f9e7-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "cinder-quobyte-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Lock "cinder-quobyte-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a75c08-60eb-467e-936c-a4f0c98b8037]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:46 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.330s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:16:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Deleted volume successfully.
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-891185e1-9a9e-4797-9f55-b8e2bd48ec31 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "cinder-a9e7756c-3fb9-4de2-81cc-9411e11c5053-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:46 devstack sudo[108557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb
Aug 26 17:16:46 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:46 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb" returned: 0 in 0.398s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:46 devstack sudo[108562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb
Aug 26 17:16:46 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:46 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb" returned: 0 in 0.244s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Lock "cinder-quobyte-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb" released by "delete_volume" :: held 0.687s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:46 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Created reservations ['bfdb57ad-cd64-4676-b52c-3d18775f2117', '3fb49534-6c34-4c66-a87c-8ba0e5ae4d22', '79a7a92a-186b-4a1f-aada-ccc1d85c9f71', '95957282-88fb-418d-8212-c5a1dac1884b'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:47 devstack sudo[108565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:16:47 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:47 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.266s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:16:47 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Deleted volume successfully.
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0dd301c7-c9bb-463e-8f83-d609943e3b6d tempest-VolumesListAdminTestJSON-1972998056 None] Lock "cinder-bdd0ba8f-95d1-469e-ba1a-70648aa2fadb-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "cinder-b094e090-4315-43ae-9c2a-0a33a23273d2-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "cinder-b094e090-4315-43ae-9c2a-0a33a23273d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "cinder-quobyte-b094e090-4315-43ae-9c2a-0a33a23273d2" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "cinder-quobyte-b094e090-4315-43ae-9c2a-0a33a23273d2" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaf1a2a-18da-4acb-be38-7dbe9d7e8514]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b094e090-4315-43ae-9c2a-0a33a23273d2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:47 devstack sudo[108568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b094e090-4315-43ae-9c2a-0a33a23273d2
Aug 26 17:16:47 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:47 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b094e090-4315-43ae-9c2a-0a33a23273d2" returned: 0 in 0.400s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b094e090-4315-43ae-9c2a-0a33a23273d2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:47 devstack sudo[108573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b094e090-4315-43ae-9c2a-0a33a23273d2
Aug 26 17:16:47 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:48 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b094e090-4315-43ae-9c2a-0a33a23273d2" returned: 0 in 0.254s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "cinder-quobyte-b094e090-4315-43ae-9c2a-0a33a23273d2" released by "delete_volume" :: held 0.702s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:48 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Created reservations ['775e870d-6218-40e2-8352-edbcbb9ff987', 'a3ea61f9-1ba1-4cc1-8c7a-221a98405967', '18d580e2-14d3-41cc-b5d8-257771e6c8d4', '4f82cc07-137f-407b-9f13-f81d161bc444'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:16:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:48 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:16:48 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:48 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.427s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:48 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:16:48 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Deleted volume successfully.
Aug 26 17:16:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e19443fd-d212-4544-9f71-7d94288aa476 tempest-VolumesListAdminTestJSON-1972998056 None] Lock "cinder-b094e090-4315-43ae-9c2a-0a33a23273d2-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Flow 'volume_create_manager' (e1d26679-99c5-44b6-99ef-2b96d3a04a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b36d009-ddcc-40e6-98da-43efafcd7c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b36d009-ddcc-40e6-98da-43efafcd7c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-37574110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=481292ba-cfe8-467d-9b3d-948c428dc54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffef8e565a94408a978f47aa0efef5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:57Z,use_quota=True,user_id='07b340e5008840cfba86920a7318daf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0739ea-0e01-4956-ba67-79bc1bf47867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0739ea-0e01-4956-ba67-79bc1bf47867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d85442b-d9d9-482a-a331-5261bc9d2895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d85442b-d9d9-482a-a331-5261bc9d2895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '481292ba-cfe8-467d-9b3d-948c428dc54c', 'volume_name': 'volume-481292ba-cfe8-467d-9b3d-948c428dc54c', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09540b7c-6319-4527-811a-f242094e46ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09540b7c-6319-4527-811a-f242094e46ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0242ac22-ab1e-4aff-85af-f374c8c9c95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:57 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Volume 481292ba-cfe8-467d-9b3d-948c428dc54c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-481292ba-cfe8-467d-9b3d-948c428dc54c', 'volume_size': 1}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-37574110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=481292ba-cfe8-467d-9b3d-948c428dc54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffef8e565a94408a978f47aa0efef5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:57Z,use_quota=True,user_id='07b340e5008840cfba86920a7318daf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Creating volume 481292ba-cfe8-467d-9b3d-948c428dc54c {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:16:57 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-481292ba-cfe8-467d-9b3d-948c428dc54c 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:57 devstack sudo[108621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-481292ba-cfe8-467d-9b3d-948c428dc54c 1073741824
Aug 26 17:16:57 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Flow 'volume_create_manager' (02c6875c-c230-415b-b563-a2bcabc8b78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1587329f-f98d-4624-ab0c-54001f7a85e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1587329f-f98d-4624-ab0c-54001f7a85e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1631702358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed0335da41fa40a7bdf63faaaf2454d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:58Z,use_quota=True,user_id='dcb591751b6043e1b79c91e76a517692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0927ba28-14f2-4d72-9990-b7dbf87b40e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0927ba28-14f2-4d72-9990-b7dbf87b40e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df7ffdd-19ac-4ac1-bcb6-c79a3e32a36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df7ffdd-19ac-4ac1-bcb6-c79a3e32a36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a', 'volume_name': 'volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21b5dc4-b1b3-4c63-b6eb-b032781ea6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21b5dc4-b1b3-4c63-b6eb-b032781ea6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4c8ecd-2ce0-4f24-9837-be61ead26111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:57 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Volume 1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a', 'volume_size': 1}
Aug 26 17:16:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:58 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-481292ba-cfe8-467d-9b3d-948c428dc54c 1073741824" returned: 0 in 0.651s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-481292ba-cfe8-467d-9b3d-948c428dc54c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:58 devstack sudo[108628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-481292ba-cfe8-467d-9b3d-948c428dc54c
Aug 26 17:16:58 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:58 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-481292ba-cfe8-467d-9b3d-948c428dc54c" returned: 0 in 0.301s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1631702358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed0335da41fa40a7bdf63faaaf2454d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:16:58Z,use_quota=True,user_id='dcb591751b6043e1b79c91e76a517692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Creating volume 1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:16:58 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:58 devstack sudo[108632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a 1073741824
Aug 26 17:16:58 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0242ac22-ab1e-4aff-85af-f374c8c9c95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-481292ba-cfe8-467d-9b3d-948c428dc54c', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb4b254-8db7-4dc7-ac67-b7580bab783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:58 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Volume volume-481292ba-cfe8-467d-9b3d-948c428dc54c (481292ba-cfe8-467d-9b3d-948c428dc54c): created successfully
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb4b254-8db7-4dc7-ac67-b7580bab783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Flow 'volume_create_manager' (e1d26679-99c5-44b6-99ef-2b96d3a04a11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:58 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d0fa7ba8-d996-43a0-ab3d-dd2ce1e1d47c tempest-AbsoluteLimitsTests-585124137 None] Created volume successfully.
Aug 26 17:16:58 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-6dd7fc46-dbc7-4b34-8331-7adb598cfc82 tempest-TestShelveInstance-1648727836 None] Terminate volume connection completed successfully.
Aug 26 17:16:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-6dd7fc46-dbc7-4b34-8331-7adb598cfc82 tempest-TestShelveInstance-1648727836 None] Deleting attachment 53c67bb0-1479-4fec-bfce-5586e282da4a. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Acquiring lock "cinder-ce02064f-7014-461c-977e-a64793509d30-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Lock "cinder-ce02064f-7014-461c-977e-a64793509d30-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:59 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a 1073741824" returned: 0 in 0.624s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Acquiring lock "cinder-quobyte-ce02064f-7014-461c-977e-a64793509d30" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Lock "cinder-quobyte-ce02064f-7014-461c-977e-a64793509d30" acquired by "delete_volume" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f367f75-3331-474c-87bd-142d82098a2c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:59 devstack sudo[108640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a
Aug 26 17:16:59 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:59 devstack sudo[108639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30
Aug 26 17:16:59 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Acquiring lock "cinder-481292ba-cfe8-467d-9b3d-948c428dc54c-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Lock "cinder-481292ba-cfe8-467d-9b3d-948c428dc54c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Acquiring lock "cinder-quobyte-481292ba-cfe8-467d-9b3d-948c428dc54c" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Lock "cinder-quobyte-481292ba-cfe8-467d-9b3d-948c428dc54c" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef9c162-ea06-40a4-a6e4-464a711a385f]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-481292ba-cfe8-467d-9b3d-948c428dc54c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:59 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a" returned: 0 in 0.423s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4c8ecd-2ce0-4f24-9837-be61ead26111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f093d3-d970-4d2f-9357-8e7dfba995a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:16:59 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Volume volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a (1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a): created successfully
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f093d3-d970-4d2f-9357-8e7dfba995a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Flow 'volume_create_manager' (02c6875c-c230-415b-b563-a2bcabc8b78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:16:59 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5445330c-880e-465f-b5de-e7c6c0d43339 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Created volume successfully.
Aug 26 17:16:59 devstack sudo[108644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-481292ba-cfe8-467d-9b3d-948c428dc54c
Aug 26 17:16:59 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:16:59 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30" returned: 0 in 0.694s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:16:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:16:59 devstack sudo[108649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30
Aug 26 17:16:59 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:00 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-481292ba-cfe8-467d-9b3d-948c428dc54c" returned: 0 in 0.480s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-481292ba-cfe8-467d-9b3d-948c428dc54c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:00 devstack sudo[108655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-481292ba-cfe8-467d-9b3d-948c428dc54c
Aug 26 17:17:00 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:00 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ce02064f-7014-461c-977e-a64793509d30" returned: 0 in 0.273s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Lock "cinder-quobyte-ce02064f-7014-461c-977e-a64793509d30" released by "delete_volume" :: held 1.031s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG cinder.quota [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Created reservations ['8f0184e1-a045-4f4e-b3d7-aaa739ba888f', '38b3c7f2-8b45-4bc0-bb9d-1de8d0898675', '3326d6c7-71d5-400a-9e3b-7a9059565e06', 'ac1e7a3b-720e-4897-bd99-fcdb64b7315a'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:00 devstack sudo[108658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:00 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:00 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-481292ba-cfe8-467d-9b3d-948c428dc54c" returned: 0 in 0.503s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Lock "cinder-quobyte-481292ba-cfe8-467d-9b3d-948c428dc54c" released by "delete_volume" :: held 1.062s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Created reservations ['2c889d78-2751-4f9d-8f6c-0195335c50cf', '303cbc9f-8906-4a3f-83ae-6e4bb4a2da49', '15a6ed5a-283c-4007-961f-bbea0181f83a', 'a6379f35-6ce4-4879-93fd-c280a04965dd'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:01 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.584s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:01 devstack cinder-volume[94125]: DEBUG cinder.manager [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:01 devstack sudo[108662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:01 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:01 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Deleted volume successfully.
Aug 26 17:17:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [req-c5d2729a-6264-4c96-acd5-dc8d03686f32 req-36173caf-9d62-42eb-990c-d5d0fbf417f6 tempest-TestShelveInstance-1648727836 None] Lock "cinder-ce02064f-7014-461c-977e-a64793509d30-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:01 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.334s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:01 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:01 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Deleted volume successfully.
Aug 26 17:17:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5e9978c2-be4f-4696-b4c5-61babdc89332 tempest-AbsoluteLimitsTests-585124137 None] Lock "cinder-481292ba-cfe8-467d-9b3d-948c428dc54c-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:02 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=92,cinder:UPDATE=114,cinder:DELETE=7,cinder:INSERT=35 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:17:02 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=129,cinder:SELECT=88,cinder:INSERT=32,cinder:DELETE=14 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:17:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-5e64a718-c413-46e4-9075-a176a6c970ff req-9857eb38-1339-4ca9-999d-42812c1a15d6 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-5e64a718-c413-46e4-9075-a176a6c970ff req-9857eb38-1339-4ca9-999d-42812c1a15d6 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-5e64a718-c413-46e4-9075-a176a6c970ff req-9857eb38-1339-4ca9-999d-42812c1a15d6 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-5e64a718-c413-46e4-9075-a176a6c970ff req-9857eb38-1339-4ca9-999d-42812c1a15d6 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84590e13-5b26-4c0b-ad5b-6f38dba7b411', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:17:02 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-5e64a718-c413-46e4-9075-a176a6c970ff req-9857eb38-1339-4ca9-999d-42812c1a15d6 tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] attachment_update completed successfully.
Aug 26 17:17:05 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-7f0e2185-6d9b-48cf-b163-6f968fe773ce req-c3f3fdc7-98f3-4e68-99cd-de505aa9429d tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Terminate volume connection completed successfully.
Aug 26 17:17:05 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-7f0e2185-6d9b-48cf-b163-6f968fe773ce req-c3f3fdc7-98f3-4e68-99cd-de505aa9429d tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Deleting attachment 84590e13-5b26-4c0b-ad5b-6f38dba7b411. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:17:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Acquiring lock "cinder-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Lock "cinder-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Acquiring lock "cinder-quobyte-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Lock "cinder-quobyte-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a" acquired by "delete_volume" :: waited 0.029s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:06 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc685e2-3618-49b4-8a3f-c6837b97c68f]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:07 devstack sudo[109097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a
Aug 26 17:17:07 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:07 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a" returned: 0 in 0.516s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:07 devstack sudo[109102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a
Aug 26 17:17:07 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:07 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a" returned: 0 in 0.294s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Lock "cinder-quobyte-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a" released by "delete_volume" :: held 0.877s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:07 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Created reservations ['f01b35cf-a098-4237-a62e-0ed190dc32b6', '00be7246-26a7-4012-87a5-edb4aa62ce4b', '65d8a3f6-f56a-456e-8e08-95fa31d6f4e9', '04420740-f9da-435f-8e1f-29fe1c6b3ee7'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:07 devstack sudo[109105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:07 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:08 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.529s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:08 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:08 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Deleted volume successfully.
Aug 26 17:17:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2ec2cebd-d125-4f61-b703-718e356ec15b tempest-TestServerVolumeAttachScenarioOldVersion-499338725 None] Lock "cinder-1dd9f0e4-ed2b-49d1-8dea-e7591b4e476a-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Flow 'volume_create_manager' (6a7978ca-3287-4454-b4ff-dedbc8292f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985e6137-de86-45ab-8306-cd6bb1cdaddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985e6137-de86-45ab-8306-cd6bb1cdaddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-872626991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4353d6a9-d30f-43a1-b738-1b430eae57f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='950726491e64481580ada2f1f51532ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:12Z,use_quota=True,user_id='646fd8b3f7f148e9b7db7ecc4fb7b1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(964b4b86-bd13-4431-b3da-dbe4865d1b7d),volume_type_id=964b4b86-bd13-4431-b3da-dbe4865d1b7d)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ff95f5-bb8d-4f8b-a86d-b57a8933e421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ff95f5-bb8d-4f8b-a86d-b57a8933e421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77a8562-00e0-4bf4-aa7a-b4b777fd2b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77a8562-00e0-4bf4-aa7a-b4b777fd2b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4353d6a9-d30f-43a1-b738-1b430eae57f8', 'volume_name': 'volume-4353d6a9-d30f-43a1-b738-1b430eae57f8', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c7bbc3-979c-4492-b64a-9082da227792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c7bbc3-979c-4492-b64a-9082da227792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c076bd13-1a11-414a-aab5-1fd924389e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Volume 4353d6a9-d30f-43a1-b738-1b430eae57f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4353d6a9-d30f-43a1-b738-1b430eae57f8', 'volume_size': 1}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-872626991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4353d6a9-d30f-43a1-b738-1b430eae57f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='950726491e64481580ada2f1f51532ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:12Z,use_quota=True,user_id='646fd8b3f7f148e9b7db7ecc4fb7b1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(964b4b86-bd13-4431-b3da-dbe4865d1b7d),volume_type_id=964b4b86-bd13-4431-b3da-dbe4865d1b7d)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Creating volume 4353d6a9-d30f-43a1-b738-1b430eae57f8 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:12 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4353d6a9-d30f-43a1-b738-1b430eae57f8 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:12 devstack sudo[109138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4353d6a9-d30f-43a1-b738-1b430eae57f8 1073741824
Aug 26 17:17:12 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Flow 'volume_create_manager' (737a3e3e-ec8b-49a5-9ae0-d8d9a533c59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea38087-6f4a-47ea-95e2-0815abcde0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea38087-6f4a-47ea-95e2-0815abcde0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-624201174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1688b1bb-ed43-46de-820c-3af7bae8450a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='950726491e64481580ada2f1f51532ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:13Z,use_quota=True,user_id='646fd8b3f7f148e9b7db7ecc4fb7b1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de6a7d4-e2f4-44bf-b904-6ace58bb559a),volume_type_id=1de6a7d4-e2f4-44bf-b904-6ace58bb559a)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b21f7a8-1da9-4128-b9a4-b4aeea26a608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b21f7a8-1da9-4128-b9a4-b4aeea26a608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ace5e2-15d2-4992-b015-8ab420c779c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ace5e2-15d2-4992-b015-8ab420c779c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1688b1bb-ed43-46de-820c-3af7bae8450a', 'volume_name': 'volume-1688b1bb-ed43-46de-820c-3af7bae8450a', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5742b63-1d3a-4cef-89c1-7ada8442e516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5742b63-1d3a-4cef-89c1-7ada8442e516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6003a9-c80d-45d6-b1b5-635751eecfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Volume 1688b1bb-ed43-46de-820c-3af7bae8450a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1688b1bb-ed43-46de-820c-3af7bae8450a', 'volume_size': 1}
Aug 26 17:17:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:13 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4353d6a9-d30f-43a1-b738-1b430eae57f8 1073741824" returned: 0 in 0.876s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4353d6a9-d30f-43a1-b738-1b430eae57f8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:13 devstack sudo[109144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4353d6a9-d30f-43a1-b738-1b430eae57f8
Aug 26 17:17:13 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Flow 'volume_create_manager' (e19ddea9-94ed-48f7-a6f3-642e35916852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d28649d-4c6b-4c50-ad7c-d005880f6713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d28649d-4c6b-4c50-ad7c-d005880f6713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1843429435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e35cd9-ed72-4300-8365-33e1577c12cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d2df27d2d4365b8e0f0b1e3344f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:13Z,use_quota=True,user_id='c1aa9e2e145b403ea5a58203ac0a496f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61ac543-f0e8-418e-89cc-47747e613a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61ac543-f0e8-418e-89cc-47747e613a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2496e9-712b-4514-81b7-4df575de7a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2496e9-712b-4514-81b7-4df575de7a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e35cd9-ed72-4300-8365-33e1577c12cb', 'volume_name': 'volume-a1e35cd9-ed72-4300-8365-33e1577c12cb', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a351cb2-a347-4e32-a6f5-8d738a0e896f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a351cb2-a347-4e32-a6f5-8d738a0e896f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212a5f2a-2522-416a-9f08-53409bb3dba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:13 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Volume a1e35cd9-ed72-4300-8365-33e1577c12cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e35cd9-ed72-4300-8365-33e1577c12cb', 'volume_size': 1}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:13 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4353d6a9-d30f-43a1-b738-1b430eae57f8" returned: 0 in 0.373s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-624201174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1688b1bb-ed43-46de-820c-3af7bae8450a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='950726491e64481580ada2f1f51532ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:13Z,use_quota=True,user_id='646fd8b3f7f148e9b7db7ecc4fb7b1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de6a7d4-e2f4-44bf-b904-6ace58bb559a),volume_type_id=1de6a7d4-e2f4-44bf-b904-6ace58bb559a)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Creating volume 1688b1bb-ed43-46de-820c-3af7bae8450a {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:13 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1688b1bb-ed43-46de-820c-3af7bae8450a 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c076bd13-1a11-414a-aab5-1fd924389e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4353d6a9-d30f-43a1-b738-1b430eae57f8', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be2ab02-e192-4790-a343-2f1eac12982d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:13 devstack sudo[109148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1688b1bb-ed43-46de-820c-3af7bae8450a 1073741824
Aug 26 17:17:13 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:13 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Volume volume-4353d6a9-d30f-43a1-b738-1b430eae57f8 (4353d6a9-d30f-43a1-b738-1b430eae57f8): created successfully
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be2ab02-e192-4790-a343-2f1eac12982d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Flow 'volume_create_manager' (6a7978ca-3287-4454-b4ff-dedbc8292f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:13 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-42363843-cb5f-4aa7-a239-e5d74cd8cecf tempest-TestInstancesWithCinderVolumes-7102684 None] Created volume successfully.
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Flow 'volume_create_manager' (f2c45337-aefd-424f-b3a8-5f337e99ddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dde992-d83f-462f-a43e-7369d64d17b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dde992-d83f-462f-a43e-7369d64d17b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1718290633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b21d31e-7c1c-4a82-8f5e-16cf77d95488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='950726491e64481580ada2f1f51532ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:14Z,use_quota=True,user_id='646fd8b3f7f148e9b7db7ecc4fb7b1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68a3b48a-c28f-4350-8e79-80f7b0660c20),volume_type_id=68a3b48a-c28f-4350-8e79-80f7b0660c20)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fb5124-9e11-4cae-94bb-8ef09e912645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fb5124-9e11-4cae-94bb-8ef09e912645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276f77a6-7509-48af-b588-1a8520aaa168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:13 devstack cinder-volume[94125]: DEBUG cinder.image.glance [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Creating Keystone auth plugin from conf {{(pid=94125) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 17:17:14 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1688b1bb-ed43-46de-820c-3af7bae8450a 1073741824" returned: 0 in 0.684s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1688b1bb-ed43-46de-820c-3af7bae8450a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:14 devstack sudo[109153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1688b1bb-ed43-46de-820c-3af7bae8450a
Aug 26 17:17:14 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276f77a6-7509-48af-b588-1a8520aaa168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b21d31e-7c1c-4a82-8f5e-16cf77d95488', 'volume_name': 'volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488', 'volume_size': 1, 'image_id': '9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--498531573', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '950726491e64481580ada2f1f51532ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'created_at': datetime.datetime(2026, 8, 26, 15, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 17, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b900a36-19f6-4e4b-bfdc-0a39ce770f07/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fcbf29f0>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0af496-6d3f-4247-acff-c090e4511b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0af496-6d3f-4247-acff-c090e4511b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d0e43b-6611-4ea3-9595-0d120bf1ea09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:14 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Volume 0b21d31e-7c1c-4a82-8f5e-16cf77d95488: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488', 'volume_size': 1, 'image_id': '9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--498531573', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '950726491e64481580ada2f1f51532ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'created_at': datetime.datetime(2026, 8, 26, 15, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 17, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b900a36-19f6-4e4b-bfdc-0a39ce770f07/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fcbf29f0>}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Trying to clone 0b21d31e-7c1c-4a82-8f5e-16cf77d95488 from image 9b900a36-19f6-4e4b-bfdc-0a39ce770f07 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'metadata': {}}]). {{(pid=94125) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 17:17:14 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1688b1bb-ed43-46de-820c-3af7bae8450a" returned: 0 in 0.399s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.212s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1843429435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e35cd9-ed72-4300-8365-33e1577c12cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d2df27d2d4365b8e0f0b1e3344f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:13Z,use_quota=True,user_id='c1aa9e2e145b403ea5a58203ac0a496f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Creating volume a1e35cd9-ed72-4300-8365-33e1577c12cb {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:14 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a1e35cd9-ed72-4300-8365-33e1577c12cb 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:14 devstack sudo[109156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a1e35cd9-ed72-4300-8365-33e1577c12cb 1073741824
Aug 26 17:17:14 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6003a9-c80d-45d6-b1b5-635751eecfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1688b1bb-ed43-46de-820c-3af7bae8450a', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02f9511-c902-4a84-a042-d8782d419408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:14 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Volume volume-1688b1bb-ed43-46de-820c-3af7bae8450a (1688b1bb-ed43-46de-820c-3af7bae8450a): created successfully
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02f9511-c902-4a84-a042-d8782d419408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Flow 'volume_create_manager' (737a3e3e-ec8b-49a5-9ae0-d8d9a533c59c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:15 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-28508e17-82b5-4f4f-bc11-b0b45842e567 tempest-TestInstancesWithCinderVolumes-7102684 None] Created volume successfully.
Aug 26 17:17:15 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a1e35cd9-ed72-4300-8365-33e1577c12cb 1073741824" returned: 0 in 0.748s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a1e35cd9-ed72-4300-8365-33e1577c12cb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:15 devstack sudo[109162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a1e35cd9-ed72-4300-8365-33e1577c12cb
Aug 26 17:17:15 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:16 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a1e35cd9-ed72-4300-8365-33e1577c12cb" returned: 0 in 0.413s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212a5f2a-2522-416a-9f08-53409bb3dba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e35cd9-ed72-4300-8365-33e1577c12cb', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f02081f-b6ab-4c9c-823a-0fd6fcc8f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:16 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Volume volume-a1e35cd9-ed72-4300-8365-33e1577c12cb (a1e35cd9-ed72-4300-8365-33e1577c12cb): created successfully
Aug 26 17:17:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f02081f-b6ab-4c9c-823a-0fd6fcc8f703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Flow 'volume_create_manager' (e19ddea9-94ed-48f7-a6f3-642e35916852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:16 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-021bb35a-b538-4cfc-a912-3cf2548c8ac1 tempest-VolumesTransfersV355Test-462981552 None] Created volume successfully.
Aug 26 17:17:17 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-22d7ea53-c83c-439a-96e9-e0a6f1de926f tempest-VolumesTransfersV355Test-482522031 None] Transfer volume completed successfully.
Aug 26 17:17:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Acquiring lock "cinder-a1e35cd9-ed72-4300-8365-33e1577c12cb-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Lock "cinder-a1e35cd9-ed72-4300-8365-33e1577c12cb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Acquiring lock "cinder-quobyte-a1e35cd9-ed72-4300-8365-33e1577c12cb" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Lock "cinder-quobyte-a1e35cd9-ed72-4300-8365-33e1577c12cb" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:18 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42a2653-ab0e-4a46-b8fb-9afd9ce84102]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a1e35cd9-ed72-4300-8365-33e1577c12cb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:18 devstack sudo[109168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a1e35cd9-ed72-4300-8365-33e1577c12cb
Aug 26 17:17:18 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:19 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a1e35cd9-ed72-4300-8365-33e1577c12cb" returned: 0 in 0.511s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a1e35cd9-ed72-4300-8365-33e1577c12cb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:19 devstack sudo[109174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a1e35cd9-ed72-4300-8365-33e1577c12cb
Aug 26 17:17:19 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD, size 20.69 MB, duration 4.75 sec {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 17:17:19 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Image download 20.69 MB at 4.36 MB/s
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d45e5c-241d-42cc-9ba5-962b35743bec]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:19 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a1e35cd9-ed72-4300-8365-33e1577c12cb" returned: 0 in 0.319s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Lock "cinder-quobyte-a1e35cd9-ed72-4300-8365-33e1577c12cb" released by "delete_volume" :: held 0.885s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:19 devstack sudo[109177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Created reservations ['ee41b52d-2ad3-4d84-8485-008f2ad405bf', '337e9e20-b409-492b-bfcc-674fd91411fa', '89abb1ed-cf11-4fc1-8b22-e798147fee55', '34796891-aeb7-4d88-95e5-505b07bad722'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:19 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:19 devstack sudo[109179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:19 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:19 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Temporary image 9b900a36-19f6-4e4b-bfdc-0a39ce770f07 is fetched for user 646fd8b3f7f148e9b7db7ecc4fb7b1e7. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ab3c19-ba5a-4876-acdd-8c8b1a4612f2]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:19 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.298s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Deleted volume successfully.
Aug 26 17:17:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a7c71984-dd03-494b-b7a1-31e8dc049a69 tempest-VolumesTransfersV355Test-501042236 None] Lock "cinder-a1e35cd9-ed72-4300-8365-33e1577c12cb-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:20 devstack sudo[109186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD
Aug 26 17:17:20 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:20 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1718290633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b21d31e-7c1c-4a82-8f5e-16cf77d95488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='950726491e64481580ada2f1f51532ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:14Z,use_quota=True,user_id='646fd8b3f7f148e9b7db7ecc4fb7b1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68a3b48a-c28f-4350-8e79-80f7b0660c20),volume_type_id=68a3b48a-c28f-4350-8e79-80f7b0660c20)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Creating volume 0b21d31e-7c1c-4a82-8f5e-16cf77d95488 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:20 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:20 devstack sudo[109192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488 1073741824
Aug 26 17:17:20 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:20 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488 1073741824" returned: 0 in 0.649s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:21 devstack sudo[109232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488
Aug 26 17:17:21 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:21 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488" returned: 0 in 0.347s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:21 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Attempting download of 9b900a36-19f6-4e4b-bfdc-0a39ce770f07 ((None, [{'url': 'file:///opt/stack/data/glance/images/9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'metadata': {}}])) to volume 0b21d31e-7c1c-4a82-8f5e-16cf77d95488. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 17:17:21 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e9994d-5987-447d-b4b9-35f580790830]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_540miea_ {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:21 devstack sudo[109237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_540miea_
Aug 26 17:17:21 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:21 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_540miea_" returned: 0 in 0.432s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_540miea_ {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:22 devstack sudo[109242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_540miea_
Aug 26 17:17:22 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Flow 'volume_create_manager' (ac264feb-7770-45bd-9bfe-1f92cd8b100a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb5269b-8796-4398-ae83-67508d077358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Flow 'volume_create_manager' (c5976eec-a6af-4fbc-8a4e-45d673ac4092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342dbda8-ac1f-4020-af2d-7c28b9c9a670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342dbda8-ac1f-4020-af2d-7c28b9c9a670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1608157141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23b2cde-acf8-4e90-ab8b-d86e48e51af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea903c541df41d2b3304702d9ff4706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:22Z,use_quota=True,user_id='06b5a82156f342f3a5896477f51bb040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063cf7ad-a194-44ce-b9cd-e1db02939491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063cf7ad-a194-44ce-b9cd-e1db02939491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f25d63-034b-4e48-b886-2692af756bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f25d63-034b-4e48-b886-2692af756bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a23b2cde-acf8-4e90-ab8b-d86e48e51af0', 'volume_name': 'volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e1f558-68b2-4ad4-a08a-18d3dc9513bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e1f558-68b2-4ad4-a08a-18d3dc9513bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a5dd00-770e-4dcb-b379-87d6596b4c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Volume a23b2cde-acf8-4e90-ab8b-d86e48e51af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0', 'volume_size': 1}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1608157141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23b2cde-acf8-4e90-ab8b-d86e48e51af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea903c541df41d2b3304702d9ff4706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:22Z,use_quota=True,user_id='06b5a82156f342f3a5896477f51bb040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Creating volume a23b2cde-acf8-4e90-ab8b-d86e48e51af0 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:22 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb5269b-8796-4398-ae83-67508d077358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-10081485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5763c21-0c07-4947-9349-f47ddf687718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d2df27d2d4365b8e0f0b1e3344f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:22Z,use_quota=True,user_id='c1aa9e2e145b403ea5a58203ac0a496f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack sudo[109245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0 1073741824
Aug 26 17:17:22 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546849a2-b763-46ff-80dc-efad01c13ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546849a2-b763-46ff-80dc-efad01c13ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87416ad-0360-4cd0-8790-4cbac6954496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87416ad-0360-4cd0-8790-4cbac6954496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5763c21-0c07-4947-9349-f47ddf687718', 'volume_name': 'volume-b5763c21-0c07-4947-9349-f47ddf687718', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06e0066-8fc6-41b4-ab52-f4026b921e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06e0066-8fc6-41b4-ab52-f4026b921e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d5afdf-783a-4467-9d9c-c02b3f211fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Volume b5763c21-0c07-4947-9349-f47ddf687718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5763c21-0c07-4947-9349-f47ddf687718', 'volume_size': 1}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:22 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_540miea_" returned: 1 in 0.676s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_540miea_' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[90829086-4fed-49a0-9ce4-a5333b9dc37b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Flow 'volume_create_manager' (94ad58f0-20b3-4675-a6ec-5623aa05237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1197b8-09e2-4984-aa64-f4c39d43ae78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Flow 'volume_create_manager' (2d3c23a0-5602-42e1-9607-8665be992903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105c9a16-ea4b-4a13-979f-461f689d3290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1197b8-09e2-4984-aa64-f4c39d43ae78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1314992429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86678a0-4597-4537-bc2f-48b2601295ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea903c541df41d2b3304702d9ff4706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:22Z,use_quota=True,user_id='06b5a82156f342f3a5896477f51bb040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f689fa9a-0d80-445c-b826-f2ab25e28be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack sudo[109249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD
Aug 26 17:17:22 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f689fa9a-0d80-445c-b826-f2ab25e28be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b20853-b414-4f8d-b6f2-86fc328a23ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b20853-b414-4f8d-b6f2-86fc328a23ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b86678a0-4597-4537-bc2f-48b2601295ef', 'volume_name': 'volume-b86678a0-4597-4537-bc2f-48b2601295ef', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2120231-2762-443f-aa10-036396fc6a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2120231-2762-443f-aa10-036396fc6a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1316ac8c-a8fa-45da-91d5-1a2dc6379cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Volume b86678a0-4597-4537-bc2f-48b2601295ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b86678a0-4597-4537-bc2f-48b2601295ef', 'volume_size': 1}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105c9a16-ea4b-4a13-979f-461f689d3290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-20541373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea903c541df41d2b3304702d9ff4706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:23Z,use_quota=True,user_id='06b5a82156f342f3a5896477f51bb040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c270591-4fa2-448f-8939-d305e26d1dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c270591-4fa2-448f-8939-d305e26d1dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0993b1df-ce69-4f1d-b226-9bcc109b81fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0993b1df-ce69-4f1d-b226-9bcc109b81fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9', 'volume_name': 'volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ddccdc-a0a0-47c8-a84b-e90072112a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ddccdc-a0a0-47c8-a84b-e90072112a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172d55c2-2479-40b0-86f2-8afeea2ffa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:22 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Volume ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9', 'volume_size': 1}
Aug 26 17:17:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Flow 'volume_create_manager' (6d342a14-a0b1-41c3-89ec-154647dfc262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:23 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c341b8e-2559-4cd6-a598-15a4a1337319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0 1073741824" returned: 0 in 0.694s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:23 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] 9b900a36-19f6-4e4b-bfdc-0a39ce770f07 was qcow2, converting to qcow2 {{(pid=94125) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c341b8e-2559-4cd6-a598-15a4a1337319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-883794052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cfc56b-bbb6-40d3-9480-0fdb17778ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea903c541df41d2b3304702d9ff4706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:23Z,use_quota=True,user_id='06b5a82156f342f3a5896477f51bb040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9a5af9-5e84-4820-8518-cade6e50ba93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:23 devstack sudo[109258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488
Aug 26 17:17:23 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9a5af9-5e84-4820-8518-cade6e50ba93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2e4ee5-b352-4a36-829b-f4f9a6163ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2e4ee5-b352-4a36-829b-f4f9a6163ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17cfc56b-bbb6-40d3-9480-0fdb17778ed6', 'volume_name': 'volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c84a4c-a691-44a8-af02-14b572bed74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c84a4c-a691-44a8-af02-14b572bed74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0670a97-a055-44eb-99b3-dea88b7b9f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:23 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Volume 17cfc56b-bbb6-40d3-9480-0fdb17778ed6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6', 'volume_size': 1}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:23 devstack sudo[109261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0
Aug 26 17:17:23 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Flow 'volume_create_manager' (fa7e29f8-2168-4554-97ad-6445adecbba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fa101e-6785-4269-a66d-ed33d82ce04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fa101e-6785-4269-a66d-ed33d82ce04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-78259359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8425917-5229-4a52-b473-269ba6f12450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea903c541df41d2b3304702d9ff4706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:24Z,use_quota=True,user_id='06b5a82156f342f3a5896477f51bb040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f895d5c-019f-467e-bda3-3096311b5a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f895d5c-019f-467e-bda3-3096311b5a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e05aec-60fc-4f83-b167-62e94d825e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e05aec-60fc-4f83-b167-62e94d825e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8425917-5229-4a52-b473-269ba6f12450', 'volume_name': 'volume-d8425917-5229-4a52-b473-269ba6f12450', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa68b4da-8ed3-4be0-a7ed-b9a7556c620f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa68b4da-8ed3-4be0-a7ed-b9a7556c620f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a812848-8ebe-4152-9539-d9599fdd9c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:23 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Volume d8425917-5229-4a52-b473-269ba6f12450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8425917-5229-4a52-b473-269ba6f12450', 'volume_size': 1}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:23 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0" returned: 0 in 0.386s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-10081485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5763c21-0c07-4947-9349-f47ddf687718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611d2df27d2d4365b8e0f0b1e3344f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:22Z,use_quota=True,user_id='c1aa9e2e145b403ea5a58203ac0a496f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Creating volume b5763c21-0c07-4947-9349-f47ddf687718 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:23 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b5763c21-0c07-4947-9349-f47ddf687718 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:23 devstack sudo[109268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b5763c21-0c07-4947-9349-f47ddf687718 1073741824
Aug 26 17:17:23 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a5dd00-770e-4dcb-b379-87d6596b4c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df9dd86-7820-4ab6-9eda-315e6e51bf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:23 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Volume volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0 (a23b2cde-acf8-4e90-ab8b-d86e48e51af0): created successfully
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df9dd86-7820-4ab6-9eda-315e6e51bf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Flow 'volume_create_manager' (c5976eec-a6af-4fbc-8a4e-45d673ac4092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:23 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0cb4f677-ee10-463f-a78f-c9cb0cea3915 tempest-CreateVolumesFromImageTest-204159229 None] Created volume successfully.
Aug 26 17:17:24 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b5763c21-0c07-4947-9349-f47ddf687718 1073741824" returned: 0 in 0.585s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b5763c21-0c07-4947-9349-f47ddf687718 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:24 devstack sudo[109276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b5763c21-0c07-4947-9349-f47ddf687718
Aug 26 17:17:24 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:24 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b5763c21-0c07-4947-9349-f47ddf687718" returned: 0 in 0.275s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1314992429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86678a0-4597-4537-bc2f-48b2601295ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea903c541df41d2b3304702d9ff4706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:22Z,use_quota=True,user_id='06b5a82156f342f3a5896477f51bb040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Creating volume b86678a0-4597-4537-bc2f-48b2601295ef {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:24 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b86678a0-4597-4537-bc2f-48b2601295ef 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:24 devstack sudo[109279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b86678a0-4597-4537-bc2f-48b2601295ef 1073741824
Aug 26 17:17:24 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d5afdf-783a-4467-9d9c-c02b3f211fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5763c21-0c07-4947-9349-f47ddf687718', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65a689c-b7ca-493e-958d-63c8395e12a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:24 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Volume volume-b5763c21-0c07-4947-9349-f47ddf687718 (b5763c21-0c07-4947-9349-f47ddf687718): created successfully
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65a689c-b7ca-493e-958d-63c8395e12a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:24 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Flow 'volume_create_manager' (ac264feb-7770-45bd-9bfe-1f92cd8b100a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:24 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d100bc45-6ff6-4388-a3fd-779c520a3a4c tempest-VolumesTransfersV355Test-462981552 None] Created volume successfully.
Aug 26 17:17:25 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b86678a0-4597-4537-bc2f-48b2601295ef 1073741824" returned: 0 in 0.568s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Acquiring lock "cinder-b5763c21-0c07-4947-9349-f47ddf687718-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b86678a0-4597-4537-bc2f-48b2601295ef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Lock "cinder-b5763c21-0c07-4947-9349-f47ddf687718-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:25 devstack sudo[109286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b86678a0-4597-4537-bc2f-48b2601295ef
Aug 26 17:17:25 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Acquiring lock "cinder-quobyte-b5763c21-0c07-4947-9349-f47ddf687718" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Lock "cinder-quobyte-b5763c21-0c07-4947-9349-f47ddf687718" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[178d7c6a-fefd-42c2-baa7-b741c41b15bf]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b5763c21-0c07-4947-9349-f47ddf687718 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:25 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488" returned: 0 in 2.294s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b900a36-19f6-4e4b-bfdc-0a39ce770f07_gi7zm0iydevstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:17:25 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Converted 112.00 MB image at 48.80 MB/s
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:25 devstack sudo[109289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488 1G
Aug 26 17:17:25 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:25 devstack sudo[109288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b5763c21-0c07-4947-9349-f47ddf687718
Aug 26 17:17:25 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:25 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b86678a0-4597-4537-bc2f-48b2601295ef" returned: 0 in 0.340s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.685s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-20541373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea903c541df41d2b3304702d9ff4706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:23Z,use_quota=True,user_id='06b5a82156f342f3a5896477f51bb040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Creating volume ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:25 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1316ac8c-a8fa-45da-91d5-1a2dc6379cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86678a0-4597-4537-bc2f-48b2601295ef', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeef409a-c56e-40d4-9e64-b2888a7646a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:25 devstack sudo[109293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9 1073741824
Aug 26 17:17:25 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:25 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Volume volume-b86678a0-4597-4537-bc2f-48b2601295ef (b86678a0-4597-4537-bc2f-48b2601295ef): created successfully
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeef409a-c56e-40d4-9e64-b2888a7646a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Flow 'volume_create_manager' (94ad58f0-20b3-4675-a6ec-5623aa05237a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:25 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ab1ea276-1556-42c4-966d-1e1a91d4f3f2 tempest-CreateVolumesFromImageTest-204159229 None] Created volume successfully.
Aug 26 17:17:25 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488 1G" returned: 0 in 0.465s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Downloaded image 9b900a36-19f6-4e4b-bfdc-0a39ce770f07 ((None, [{'url': 'file:///opt/stack/data/glance/images/9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'metadata': {}}])) to volume 0b21d31e-7c1c-4a82-8f5e-16cf77d95488 successfully. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Temporary image 9b900a36-19f6-4e4b-bfdc-0a39ce770f07 for user 646fd8b3f7f148e9b7db7ecc4fb7b1e7 is deleted. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Marking volume 0b21d31e-7c1c-4a82-8f5e-16cf77d95488 as bootable. {{(pid=94125) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 17:17:25 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Copying metadata from image 9b900a36-19f6-4e4b-bfdc-0a39ce770f07 to 0b21d31e-7c1c-4a82-8f5e-16cf77d95488. {{(pid=94125) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Creating volume glance metadata for volume 0b21d31e-7c1c-4a82-8f5e-16cf77d95488 backed by image 9b900a36-19f6-4e4b-bfdc-0a39ce770f07 with: {'image_id': '9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'image_name': 'tempest-scenario-img--498531573', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94125) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b5763c21-0c07-4947-9349-f47ddf687718" returned: 0 in 0.562s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b5763c21-0c07-4947-9349-f47ddf687718 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:26 devstack sudo[109302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b5763c21-0c07-4947-9349-f47ddf687718
Aug 26 17:17:26 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d0e43b-6611-4ea3-9595-0d120bf1ea09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488', 'volume_size': 1, 'image_id': '9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--498531573', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '950726491e64481580ada2f1f51532ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b900a36-19f6-4e4b-bfdc-0a39ce770f07', 'created_at': datetime.datetime(2026, 8, 26, 15, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 17, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b900a36-19f6-4e4b-bfdc-0a39ce770f07/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fcbf29f0>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca4ec25-94b1-46d9-a8df-18c6e32c417d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:26 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Volume volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488 (0b21d31e-7c1c-4a82-8f5e-16cf77d95488): created successfully
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca4ec25-94b1-46d9-a8df-18c6e32c417d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Flow 'volume_create_manager' (f2c45337-aefd-424f-b3a8-5f337e99ddc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:26 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ce71e8c8-7921-44e8-9ed4-144c719a5300 tempest-TestInstancesWithCinderVolumes-7102684 None] Created volume successfully.
Aug 26 17:17:26 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b5763c21-0c07-4947-9349-f47ddf687718" returned: 0 in 0.302s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Lock "cinder-quobyte-b5763c21-0c07-4947-9349-f47ddf687718" released by "delete_volume" :: held 0.929s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Created reservations ['c5b1f577-5803-4aa7-a636-cf2c88684459', '3a651638-e963-4bcb-88cf-37d8c5b925a4', '160158b0-eeae-478f-9570-1cd451a7fa95', '90d21c3f-862c-4179-a0f2-8425840ca99e'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:26 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9 1073741824" returned: 0 in 0.734s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:26 devstack sudo[109310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9
Aug 26 17:17:26 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:26 devstack sudo[109312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:26 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:26 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9" returned: 0 in 0.324s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.482s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-883794052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cfc56b-bbb6-40d3-9480-0fdb17778ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea903c541df41d2b3304702d9ff4706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:23Z,use_quota=True,user_id='06b5a82156f342f3a5896477f51bb040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Creating volume 17cfc56b-bbb6-40d3-9480-0fdb17778ed6 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:26 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:26 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.318s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172d55c2-2479-40b0-86f2-8afeea2ffa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:26 devstack sudo[109317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6 1073741824
Aug 26 17:17:26 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62966162-7812-4e94-bfef-fcf2133b99cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:26 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Deleted volume successfully.
Aug 26 17:17:26 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Volume volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9 (ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9): created successfully
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62966162-7812-4e94-bfef-fcf2133b99cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Flow 'volume_create_manager' (2d3c23a0-5602-42e1-9607-8665be992903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7dfc024a-5355-4b05-9358-ca3aad42b3aa tempest-VolumesTransfersV355Test-501042236 None] Lock "cinder-b5763c21-0c07-4947-9349-f47ddf687718-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:26 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1b68b27a-c8c5-457d-8dc7-af74102000ff tempest-CreateVolumesFromImageTest-204159229 None] Created volume successfully.
Aug 26 17:17:27 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6 1073741824" returned: 0 in 0.559s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:27 devstack sudo[109323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6
Aug 26 17:17:27 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:27 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6" returned: 0 in 0.320s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.034s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-78259359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8425917-5229-4a52-b473-269ba6f12450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea903c541df41d2b3304702d9ff4706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:24Z,use_quota=True,user_id='06b5a82156f342f3a5896477f51bb040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Creating volume d8425917-5229-4a52-b473-269ba6f12450 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:27 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8425917-5229-4a52-b473-269ba6f12450 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0670a97-a055-44eb-99b3-dea88b7b9f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e8a4b7-fabb-44ea-8ec1-b59eac56dab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:27 devstack sudo[109326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8425917-5229-4a52-b473-269ba6f12450 1073741824
Aug 26 17:17:27 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:27 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Volume volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6 (17cfc56b-bbb6-40d3-9480-0fdb17778ed6): created successfully
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e8a4b7-fabb-44ea-8ec1-b59eac56dab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Flow 'volume_create_manager' (6d342a14-a0b1-41c3-89ec-154647dfc262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:27 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8d846352-1aed-42bb-b95b-9bc0407dfb66 tempest-CreateVolumesFromImageTest-204159229 None] Created volume successfully.
Aug 26 17:17:28 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8425917-5229-4a52-b473-269ba6f12450 1073741824" returned: 0 in 0.662s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8425917-5229-4a52-b473-269ba6f12450 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:28 devstack sudo[109341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8425917-5229-4a52-b473-269ba6f12450
Aug 26 17:17:28 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:28 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8425917-5229-4a52-b473-269ba6f12450" returned: 0 in 0.306s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a812848-8ebe-4152-9539-d9599fdd9c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8425917-5229-4a52-b473-269ba6f12450', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7232e12-cc2f-4d81-bc3d-f50d13e4817f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:28 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Volume volume-d8425917-5229-4a52-b473-269ba6f12450 (d8425917-5229-4a52-b473-269ba6f12450): created successfully
Aug 26 17:17:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7232e12-cc2f-4d81-bc3d-f50d13e4817f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Flow 'volume_create_manager' (fa7e29f8-2168-4554-97ad-6445adecbba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:28 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f5d64fcc-eff5-492f-ae76-1c7c84d2c764 tempest-CreateVolumesFromImageTest-204159229 None] Created volume successfully.
Aug 26 17:17:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "cinder-d8425917-5229-4a52-b473-269ba6f12450-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-d8425917-5229-4a52-b473-269ba6f12450-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "cinder-quobyte-d8425917-5229-4a52-b473-269ba6f12450" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-quobyte-d8425917-5229-4a52-b473-269ba6f12450" acquired by "delete_volume" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:29 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1ca7b8-15cb-43ec-9160-8905ac427e66]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8425917-5229-4a52-b473-269ba6f12450 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:29 devstack sudo[109344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8425917-5229-4a52-b473-269ba6f12450
Aug 26 17:17:29 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:30 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8425917-5229-4a52-b473-269ba6f12450" returned: 0 in 0.587s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8425917-5229-4a52-b473-269ba6f12450 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:30 devstack sudo[109349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8425917-5229-4a52-b473-269ba6f12450
Aug 26 17:17:30 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:30 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8425917-5229-4a52-b473-269ba6f12450" returned: 0 in 0.395s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-quobyte-d8425917-5229-4a52-b473-269ba6f12450" released by "delete_volume" :: held 1.088s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-59804418-0288-4878-bafe-6463a34d5c71 req-4f9fda72-2561-416d-8724-67b27104bdfa tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-59804418-0288-4878-bafe-6463a34d5c71 req-4f9fda72-2561-416d-8724-67b27104bdfa tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-59804418-0288-4878-bafe-6463a34d5c71 req-4f9fda72-2561-416d-8724-67b27104bdfa tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Created reservations ['56bb1fb1-6cbe-45cb-8a0d-939541ab6a6e', '42ecc488-b4b7-42c3-a0f1-10dabed1f25a', '58305cb1-e51e-4971-9869-64ca933c7039', '25cfcf38-9571-417f-b7a3-3aaa8114f689'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-59804418-0288-4878-bafe-6463a34d5c71 req-4f9fda72-2561-416d-8724-67b27104bdfa tempest-TestInstancesWithCinderVolumes-7102684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67ba7f5e-fdac-4452-b70e-3d18ba94f9df', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:30 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-59804418-0288-4878-bafe-6463a34d5c71 req-4f9fda72-2561-416d-8724-67b27104bdfa tempest-TestInstancesWithCinderVolumes-7102684 None] attachment_update completed successfully.
Aug 26 17:17:30 devstack sudo[109360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:30 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:31 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.421s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:31 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Deleted volume successfully.
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c331980a-cb59-4035-b5dd-e775aa347224 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-d8425917-5229-4a52-b473-269ba6f12450-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "cinder-17cfc56b-bbb6-40d3-9480-0fdb17778ed6-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-17cfc56b-bbb6-40d3-9480-0fdb17778ed6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Flow 'volume_create_manager' (46a547ac-8ec8-4556-8add-e2c614aee411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30127ed8-4814-452c-a39c-fcc672a8699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30127ed8-4814-452c-a39c-fcc672a8699e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1766838750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2712cf71-97fc-405a-a92e-aacd76d86e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea4f9e11ff0467a8094d9808b313680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:32Z,use_quota=True,user_id='deac5142d33643c78ada0a878bb037a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e82eff3-d5e4-46f4-adef-b017e3fd95ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e82eff3-d5e4-46f4-adef-b017e3fd95ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e375cf9d-e3f3-4d8b-a7b3-927e5cb3ea9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e375cf9d-e3f3-4d8b-a7b3-927e5cb3ea9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2712cf71-97fc-405a-a92e-aacd76d86e73', 'volume_name': 'volume-2712cf71-97fc-405a-a92e-aacd76d86e73', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3fe234-30fb-4168-b54d-415e62567744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3fe234-30fb-4168-b54d-415e62567744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ee2009-dc62-40e9-8b70-596d63f62783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:31 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume 2712cf71-97fc-405a-a92e-aacd76d86e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2712cf71-97fc-405a-a92e-aacd76d86e73', 'volume_size': 1}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1766838750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2712cf71-97fc-405a-a92e-aacd76d86e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea4f9e11ff0467a8094d9808b313680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:32Z,use_quota=True,user_id='deac5142d33643c78ada0a878bb037a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Creating volume 2712cf71-97fc-405a-a92e-aacd76d86e73 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:31 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "cinder-quobyte-17cfc56b-bbb6-40d3-9480-0fdb17778ed6" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:31 devstack sudo[109363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73 1073741824
Aug 26 17:17:31 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-quobyte-17cfc56b-bbb6-40d3-9480-0fdb17778ed6" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:32 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c807049-6264-4054-a441-924f161671d7]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:32 devstack sudo[109366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6
Aug 26 17:17:32 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:32 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6" returned: 0 in 0.475s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:32 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73 1073741824" returned: 0 in 0.608s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:32 devstack sudo[109375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6
Aug 26 17:17:32 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:32 devstack sudo[109377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73
Aug 26 17:17:32 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:32 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73" returned: 0 in 0.376s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ee2009-dc62-40e9-8b70-596d63f62783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2712cf71-97fc-405a-a92e-aacd76d86e73', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4d12dc-8c0e-4a43-91ac-a6c2bef494e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:33 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume volume-2712cf71-97fc-405a-a92e-aacd76d86e73 (2712cf71-97fc-405a-a92e-aacd76d86e73): created successfully
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4d12dc-8c0e-4a43-91ac-a6c2bef494e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Flow 'volume_create_manager' (46a547ac-8ec8-4556-8add-e2c614aee411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:33 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-17cfc56b-bbb6-40d3-9480-0fdb17778ed6" returned: 0 in 0.545s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8c0f5229-71cc-48f7-a23f-59b8be34e315 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created volume successfully.
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-quobyte-17cfc56b-bbb6-40d3-9480-0fdb17778ed6" released by "delete_volume" :: held 1.104s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Created reservations ['32ca6ae0-3ca4-4b5f-b6b6-b3f73220b4e5', '104c1736-02a1-4e65-91fc-319c082e11fe', '3ca42408-688c-4ab6-8a89-0f1bcdeb2c6c', '05170b36-cc40-4513-9a8a-d4dce17985f3'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:33 devstack sudo[109382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:33 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:33 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.299s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Deleted volume successfully.
Aug 26 17:17:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-9d42bbf8-59fe-4d54-883c-cb7c443321b3 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-17cfc56b-bbb6-40d3-9480-0fdb17778ed6-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "cinder-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "cinder-quobyte-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-quobyte-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9" acquired by "delete_volume" :: waited 0.042s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:34 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10730fd-8772-45fc-9c9d-0d4490d7b943]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] Creating offline snapshot 5911e02d-f616-44a5-a3c5-1f02bd96a733 of volume 2712cf71-97fc-405a-a92e-aacd76d86e73 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:17:34 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[491c1e67-3916-4594-a584-c3e275847931]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:34 devstack sudo[109799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9
Aug 26 17:17:34 devstack sudo[109799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:34 devstack sudo[109807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73
Aug 26 17:17:34 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:35 devstack sudo[109799]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9" returned: 0 in 0.745s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:35 devstack sudo[109831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9
Aug 26 17:17:35 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:35 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73" returned: 0 in 0.642s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:35 devstack sudo[109840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733 1G
Aug 26 17:17:35 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:35 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9" returned: 0 in 0.412s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-quobyte-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9" released by "delete_volume" :: held 1.255s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Created reservations ['cc1c29af-0da5-472c-b193-b1ae10037914', '40414381-c077-4d63-b5ba-ee45771b064d', '41616750-c054-4b4a-8c06-b809ad5ccf39', '8c5b3777-c7b7-47dc-8a44-e8144d5f4522'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:35 devstack sudo[109855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:35 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:35 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733 1G" returned: 0 in 0.610s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2712cf71-97fc-405a-a92e-aacd76d86e73 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:35 devstack sudo[109862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2712cf71-97fc-405a-a92e-aacd76d86e73 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733
Aug 26 17:17:35 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:36 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.332s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Deleted volume successfully.
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c7340ec7-b39d-4861-8fce-edec7e238695 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-ec2eeae1-dc83-4aa1-b27d-e6c43b4981c9-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:36 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2712cf71-97fc-405a-a92e-aacd76d86e73 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733" returned: 0 in 0.385s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:36 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733 is being set with open permissions: ugo+rw
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:36 devstack sudo[109877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733
Aug 26 17:17:36 devstack sudo[109877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "cinder-b86678a0-4597-4537-bc2f-48b2601295ef-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-b86678a0-4597-4537-bc2f-48b2601295ef-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "cinder-quobyte-b86678a0-4597-4537-bc2f-48b2601295ef" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-quobyte-b86678a0-4597-4537-bc2f-48b2601295ef" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e6e7c2-7edc-4b9b-be73-f901938a040a]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b86678a0-4597-4537-bc2f-48b2601295ef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:36 devstack sudo[109879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b86678a0-4597-4537-bc2f-48b2601295ef
Aug 26 17:17:36 devstack sudo[109879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:36 devstack sudo[109877]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733" returned: 0 in 0.412s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:36 devstack sudo[109882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.info
Aug 26 17:17:36 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:37 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.info" returned: 0 in 0.356s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:37 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.info is being set with open permissions: ugo+rw
Aug 26 17:17:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:37 devstack sudo[109879]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b86678a0-4597-4537-bc2f-48b2601295ef" returned: 0 in 0.590s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b86678a0-4597-4537-bc2f-48b2601295ef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:37 devstack sudo[109890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.info
Aug 26 17:17:37 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:37 devstack sudo[109891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b86678a0-4597-4537-bc2f-48b2601295ef
Aug 26 17:17:37 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:37 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.info" returned: 0 in 0.452s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.999s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-051dda8c-d563-4ac3-994c-56b8d2fe46ec tempest-CreateVolumesFromSnapshotTest-1070409126 None] Create snapshot completed successfully
Aug 26 17:17:37 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b86678a0-4597-4537-bc2f-48b2601295ef" returned: 0 in 0.653s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-quobyte-b86678a0-4597-4537-bc2f-48b2601295ef" released by "delete_volume" :: held 1.305s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:37 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Created reservations ['6b1e3e55-77e8-42b6-8e2d-6915b86eef49', '9ec35e8d-aea5-49ed-a686-b73b5ba3914c', '607d3f29-82cb-4fe0-a398-86ef9f5096be', 'eb6cd990-5e84-452a-b70a-b1e226d9e1bf'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:38 devstack sudo[109896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:38 devstack sudo[109896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:38 devstack sudo[109896]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.441s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Deleted volume successfully.
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1d9f9d38-61cf-4c24-b068-717ef8ae9047 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-b86678a0-4597-4537-bc2f-48b2601295ef-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Flow 'volume_create_manager' (05794103-7855-4b09-b2b4-072575b8f83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16317e04-1a8c-42e8-b49f-c74c090b31ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16317e04-1a8c-42e8-b49f-c74c090b31ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-441882549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43104730-eb2b-4181-8293-62e0fe031212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea4f9e11ff0467a8094d9808b313680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:38Z,use_quota=True,user_id='deac5142d33643c78ada0a878bb037a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056ce677-bf47-4147-b0ff-373db00b8427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056ce677-bf47-4147-b0ff-373db00b8427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509aba58-baef-4bda-9b16-8be3a06463fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509aba58-baef-4bda-9b16-8be3a06463fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43104730-eb2b-4181-8293-62e0fe031212', 'volume_name': 'volume-43104730-eb2b-4181-8293-62e0fe031212', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bb081c-df89-44b5-b965-10aaf701ec9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bb081c-df89-44b5-b965-10aaf701ec9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72201ca8-7dc2-4858-b7c7-15fe36c6bf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:38 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume 43104730-eb2b-4181-8293-62e0fe031212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43104730-eb2b-4181-8293-62e0fe031212', 'volume_size': 1}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-441882549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43104730-eb2b-4181-8293-62e0fe031212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea4f9e11ff0467a8094d9808b313680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:38Z,use_quota=True,user_id='deac5142d33643c78ada0a878bb037a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Creating volume 43104730-eb2b-4181-8293-62e0fe031212 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:38 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-43104730-eb2b-4181-8293-62e0fe031212 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:38 devstack sudo[109899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-43104730-eb2b-4181-8293-62e0fe031212 1073741824
Aug 26 17:17:38 devstack sudo[109899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "cinder-a23b2cde-acf8-4e90-ab8b-d86e48e51af0-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:39 devstack sudo[109899]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-43104730-eb2b-4181-8293-62e0fe031212 1073741824" returned: 0 in 0.918s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-a23b2cde-acf8-4e90-ab8b-d86e48e51af0-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-43104730-eb2b-4181-8293-62e0fe031212 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:39 devstack sudo[109906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-43104730-eb2b-4181-8293-62e0fe031212
Aug 26 17:17:39 devstack sudo[109906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "cinder-quobyte-a23b2cde-acf8-4e90-ab8b-d86e48e51af0" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:39 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:39 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Flow 'volume_create_manager' (d2d733ae-2651-4e01-8d58-9f2563f249ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5757ac7a-43d3-4165-a54c-f490f331430d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5757ac7a-43d3-4165-a54c-f490f331430d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-615589671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4baa5799-ba7b-45cf-8307-d576c271cefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea4f9e11ff0467a8094d9808b313680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:40Z,use_quota=True,user_id='deac5142d33643c78ada0a878bb037a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645d4b90-524d-4a30-bd66-02dd79345d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645d4b90-524d-4a30-bd66-02dd79345d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a7b545-ba09-4712-9c7a-013e1785ac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a7b545-ba09-4712-9c7a-013e1785ac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4baa5799-ba7b-45cf-8307-d576c271cefc', 'volume_name': 'volume-4baa5799-ba7b-45cf-8307-d576c271cefc', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d30ef47-82bb-4d91-bca8-6e482dba6ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d30ef47-82bb-4d91-bca8-6e482dba6ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02024b7c-d899-4f9a-a7d1-cd0a82e20f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:40 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume 4baa5799-ba7b-45cf-8307-d576c271cefc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4baa5799-ba7b-45cf-8307-d576c271cefc', 'volume_size': 1}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-quobyte-a23b2cde-acf8-4e90-ab8b-d86e48e51af0" acquired by "delete_volume" :: waited 0.223s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd589de5-7853-4140-b2bf-7d848e9fffd5]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:40 devstack sudo[109906]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-43104730-eb2b-4181-8293-62e0fe031212" returned: 0 in 0.451s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.137s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-615589671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4baa5799-ba7b-45cf-8307-d576c271cefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea4f9e11ff0467a8094d9808b313680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:40Z,use_quota=True,user_id='deac5142d33643c78ada0a878bb037a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Creating volume 4baa5799-ba7b-45cf-8307-d576c271cefc {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:40 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4baa5799-ba7b-45cf-8307-d576c271cefc 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72201ca8-7dc2-4858-b7c7-15fe36c6bf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43104730-eb2b-4181-8293-62e0fe031212', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7db0b4-af5f-447d-87e3-e49aa1994187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:40 devstack sudo[109910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4baa5799-ba7b-45cf-8307-d576c271cefc 1073741824
Aug 26 17:17:40 devstack sudo[109910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:40 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume volume-43104730-eb2b-4181-8293-62e0fe031212 (43104730-eb2b-4181-8293-62e0fe031212): created successfully
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7db0b4-af5f-447d-87e3-e49aa1994187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Flow 'volume_create_manager' (05794103-7855-4b09-b2b4-072575b8f83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:40 devstack sudo[109909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0
Aug 26 17:17:40 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8884f08b-8af6-4245-bd55-1de4b47795c9 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created volume successfully.
Aug 26 17:17:40 devstack sudo[109909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:40 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:41 devstack sudo[109909]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Flow 'volume_create_manager' (02b66139-5bda-41b1-a013-a4627a6d6aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ada03d2-216d-4b95-9379-4bca88cffc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0" returned: 0 in 0.933s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ada03d2-216d-4b95-9379-4bca88cffc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-243534044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60867fd5-281c-4846-a6c1-f8e8900497a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac6ef56b3ad425c8d478f87c67a6428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:41Z,use_quota=True,user_id='413b2e84fb184c63895caabd31fd3283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5507ed78-d601-4163-b0c5-32e3738f99fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5507ed78-d601-4163-b0c5-32e3738f99fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6a057b-1238-4639-81b6-5efda3c74064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6a057b-1238-4639-81b6-5efda3c74064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60867fd5-281c-4846-a6c1-f8e8900497a2', 'volume_name': 'volume-60867fd5-281c-4846-a6c1-f8e8900497a2', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack sudo[109919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0
Aug 26 17:17:41 devstack sudo[109919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b8640d-7a62-4ef3-b2c1-525c0d197bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b8640d-7a62-4ef3-b2c1-525c0d197bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea369cf-ad36-4d2f-8e85-9342170ff73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Volume 60867fd5-281c-4846-a6c1-f8e8900497a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60867fd5-281c-4846-a6c1-f8e8900497a2', 'volume_size': 1}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:41 devstack sudo[109910]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4baa5799-ba7b-45cf-8307-d576c271cefc 1073741824" returned: 0 in 1.040s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Flow 'volume_create_manager' (5c010c5d-7e2a-4b06-a877-edf47f46612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5d344d-75bc-40e9-a60f-a867db7b8435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Flow 'volume_create_manager' (6e29f177-e15e-41d8-8bfb-bf707a4337df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3cfeec-a2f9-43a0-baa7-d02e1e752498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack sudo[109919]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a23b2cde-acf8-4e90-ab8b-d86e48e51af0" returned: 0 in 0.430s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5d344d-75bc-40e9-a60f-a867db7b8435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1663632177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53bfe97-ae17-48d7-94a6-84cfb94336e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea4f9e11ff0467a8094d9808b313680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:41Z,use_quota=True,user_id='deac5142d33643c78ada0a878bb037a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8463cbe0-2c89-4d8b-9000-28ff9e94ffc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8463cbe0-2c89-4d8b-9000-28ff9e94ffc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fddd4dfb-433d-4bb0-8df8-3fc0c91f3e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fddd4dfb-433d-4bb0-8df8-3fc0c91f3e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53bfe97-ae17-48d7-94a6-84cfb94336e0', 'volume_name': 'volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5c01b5-a0c3-45c4-abd7-60fa8795a446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5c01b5-a0c3-45c4-abd7-60fa8795a446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f1426c-778d-4ab4-924a-9621e8131d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume e53bfe97-ae17-48d7-94a6-84cfb94336e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0', 'volume_size': 1}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3cfeec-a2f9-43a0-baa7-d02e1e752498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1989431763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfab189-ac24-4054-b993-fe54f580bee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea4f9e11ff0467a8094d9808b313680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:41Z,use_quota=True,user_id='deac5142d33643c78ada0a878bb037a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587b61b3-7b22-49c5-b312-9e5e5cb04566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587b61b3-7b22-49c5-b312-9e5e5cb04566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9f0d17-b731-4014-81f2-c53dc33d9c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9f0d17-b731-4014-81f2-c53dc33d9c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cfab189-ac24-4054-b993-fe54f580bee0', 'volume_name': 'volume-6cfab189-ac24-4054-b993-fe54f580bee0', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0dc408-1427-40c0-81ab-88829e413bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0dc408-1427-40c0-81ab-88829e413bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce7b0bb-ab31-4a08-af46-f378f382d53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume 6cfab189-ac24-4054-b993-fe54f580bee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cfab189-ac24-4054-b993-fe54f580bee0', 'volume_size': 1}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-quobyte-a23b2cde-acf8-4e90-ab8b-d86e48e51af0" released by "delete_volume" :: held 1.668s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4baa5799-ba7b-45cf-8307-d576c271cefc {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Flow 'volume_create_manager' (ab9f1a6e-1931-4698-aa74-a010aadebfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:41 devstack sudo[109922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4baa5799-ba7b-45cf-8307-d576c271cefc
Aug 26 17:17:41 devstack sudo[109922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8730ff8-d8fd-4593-8ea4-270a8c929f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8730ff8-d8fd-4593-8ea4-270a8c929f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257545691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b486afbf-f494-4ecf-9a02-103d83c6b6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea4f9e11ff0467a8094d9808b313680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:42Z,use_quota=True,user_id='deac5142d33643c78ada0a878bb037a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01175db1-666f-42e0-a651-d020beb72af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01175db1-666f-42e0-a651-d020beb72af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98216e8-637d-487a-bb7e-9e4ae9cc5d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98216e8-637d-487a-bb7e-9e4ae9cc5d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b486afbf-f494-4ecf-9a02-103d83c6b6b1', 'volume_name': 'volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbb0554-2123-4565-8d2b-5746ffe405c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbb0554-2123-4565-8d2b-5746ffe405c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd53904-a5a6-48bc-914f-8e53cd4d9e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:41 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume b486afbf-f494-4ecf-9a02-103d83c6b6b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1', 'volume_size': 1}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:41 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Created reservations ['c7551d64-d45d-44ee-9154-fe82b73c94ac', 'a6d96fd2-98d5-483b-85ed-bf0fd9043d36', '8c4fa4d3-dd8a-4ae4-a2f8-f04792131ecd', 'ab42149b-e77b-4624-a4a0-fb28fb73f860'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:42 devstack sudo[109924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:42 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:42 devstack sudo[109926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:42 devstack sudo[109926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:42 devstack sudo[109922]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4baa5799-ba7b-45cf-8307-d576c271cefc" returned: 0 in 0.498s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.118s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-243534044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60867fd5-281c-4846-a6c1-f8e8900497a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac6ef56b3ad425c8d478f87c67a6428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:41Z,use_quota=True,user_id='413b2e84fb184c63895caabd31fd3283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Creating volume 60867fd5-281c-4846-a6c1-f8e8900497a2 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:42 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-60867fd5-281c-4846-a6c1-f8e8900497a2 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:42 devstack sudo[109929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-60867fd5-281c-4846-a6c1-f8e8900497a2 1073741824
Aug 26 17:17:42 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02024b7c-d899-4f9a-a7d1-cd0a82e20f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4baa5799-ba7b-45cf-8307-d576c271cefc', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8470502a-df94-45c7-aa83-aa246b810ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:42 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume volume-4baa5799-ba7b-45cf-8307-d576c271cefc (4baa5799-ba7b-45cf-8307-d576c271cefc): created successfully
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8470502a-df94-45c7-aa83-aa246b810ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Flow 'volume_create_manager' (d2d733ae-2651-4e01-8d58-9f2563f249ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:42 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e31ad61e-2d37-4e50-92c0-001927d09731 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created volume successfully.
Aug 26 17:17:42 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:42 devstack sudo[109926]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.592s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.651s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 28 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:17:42 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Deleted volume successfully.
Aug 26 17:17:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4b2acd66-3209-4b04-9ef2-1fc2502cc7f6 tempest-CreateVolumesFromImageTest-204159229 None] Lock "cinder-a23b2cde-acf8-4e90-ab8b-d86e48e51af0-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:43 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-60867fd5-281c-4846-a6c1-f8e8900497a2 1073741824" returned: 0 in 0.978s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-60867fd5-281c-4846-a6c1-f8e8900497a2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:43 devstack sudo[109937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-60867fd5-281c-4846-a6c1-f8e8900497a2
Aug 26 17:17:43 devstack sudo[109937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:43 devstack sudo[109937]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-60867fd5-281c-4846-a6c1-f8e8900497a2" returned: 0 in 0.376s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.172s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1663632177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53bfe97-ae17-48d7-94a6-84cfb94336e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea4f9e11ff0467a8094d9808b313680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:41Z,use_quota=True,user_id='deac5142d33643c78ada0a878bb037a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Creating volume e53bfe97-ae17-48d7-94a6-84cfb94336e0 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:43 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea369cf-ad36-4d2f-8e85-9342170ff73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60867fd5-281c-4846-a6c1-f8e8900497a2', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb320a0-88a0-4aef-beb3-2b3aacd5b51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:43 devstack sudo[109941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0 1073741824
Aug 26 17:17:43 devstack sudo[109941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:43 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Volume volume-60867fd5-281c-4846-a6c1-f8e8900497a2 (60867fd5-281c-4846-a6c1-f8e8900497a2): created successfully
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb320a0-88a0-4aef-beb3-2b3aacd5b51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Flow 'volume_create_manager' (02b66139-5bda-41b1-a013-a4627a6d6aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d035327c-7038-4d85-ac6f-dc20257a3b6f tempest-VolumesTransfersV357Test-903630499 None] Created volume successfully.
Aug 26 17:17:44 devstack sudo[109941]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0 1073741824" returned: 0 in 0.754s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:44 devstack sudo[109948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0
Aug 26 17:17:44 devstack sudo[109948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:45 devstack sudo[109948]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0" returned: 0 in 0.611s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.555s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1989431763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfab189-ac24-4054-b993-fe54f580bee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea4f9e11ff0467a8094d9808b313680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:41Z,use_quota=True,user_id='deac5142d33643c78ada0a878bb037a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Creating volume 6cfab189-ac24-4054-b993-fe54f580bee0 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:45 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-6cfab189-ac24-4054-b993-fe54f580bee0 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:45 devstack sudo[109951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-6cfab189-ac24-4054-b993-fe54f580bee0 1073741824
Aug 26 17:17:45 devstack sudo[109951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f1426c-778d-4ab4-924a-9621e8131d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f78d76-0c53-416e-accd-7ea9cf31eeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:45 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0 (e53bfe97-ae17-48d7-94a6-84cfb94336e0): created successfully
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f78d76-0c53-416e-accd-7ea9cf31eeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Flow 'volume_create_manager' (5c010c5d-7e2a-4b06-a877-edf47f46612d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7a1d7846-2f7e-4a29-bf82-4d45b475860c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created volume successfully.
Aug 26 17:17:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-34396db3-3645-42b2-8da3-3883e573a581 tempest-VolumesTransfersV357Test-1709213992 None] Transfer volume completed successfully.
Aug 26 17:17:46 devstack sudo[109951]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-6cfab189-ac24-4054-b993-fe54f580bee0 1073741824" returned: 0 in 0.773s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-6cfab189-ac24-4054-b993-fe54f580bee0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:46 devstack sudo[109958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-6cfab189-ac24-4054-b993-fe54f580bee0
Aug 26 17:17:46 devstack sudo[109958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:46 devstack sudo[109958]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-6cfab189-ac24-4054-b993-fe54f580bee0" returned: 0 in 0.546s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.776s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257545691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b486afbf-f494-4ecf-9a02-103d83c6b6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea4f9e11ff0467a8094d9808b313680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:42Z,use_quota=True,user_id='deac5142d33643c78ada0a878bb037a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Creating volume b486afbf-f494-4ecf-9a02-103d83c6b6b1 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:46 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce7b0bb-ab31-4a08-af46-f378f382d53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cfab189-ac24-4054-b993-fe54f580bee0', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608775ac-3e04-4fe2-92f4-e0ad30a26f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:46 devstack sudo[109961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1 1073741824
Aug 26 17:17:46 devstack sudo[109961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:46 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume volume-6cfab189-ac24-4054-b993-fe54f580bee0 (6cfab189-ac24-4054-b993-fe54f580bee0): created successfully
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608775ac-3e04-4fe2-92f4-e0ad30a26f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Flow 'volume_create_manager' (6e29f177-e15e-41d8-8bfb-bf707a4337df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8ab7bf35-da0e-4f2b-9026-6c4c1f516a90 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created volume successfully.
Aug 26 17:17:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Acquiring lock "cinder-60867fd5-281c-4846-a6c1-f8e8900497a2-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Lock "cinder-60867fd5-281c-4846-a6c1-f8e8900497a2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Acquiring lock "cinder-quobyte-60867fd5-281c-4846-a6c1-f8e8900497a2" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Lock "cinder-quobyte-60867fd5-281c-4846-a6c1-f8e8900497a2" acquired by "delete_volume" :: waited 0.042s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:47 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c01ed8-5070-46e0-a362-ac47530beff4]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-60867fd5-281c-4846-a6c1-f8e8900497a2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:47 devstack sudo[109966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-60867fd5-281c-4846-a6c1-f8e8900497a2
Aug 26 17:17:47 devstack sudo[109966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:47 devstack sudo[109961]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1 1073741824" returned: 0 in 0.806s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:47 devstack sudo[109968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1
Aug 26 17:17:47 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:47 devstack sudo[109966]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-60867fd5-281c-4846-a6c1-f8e8900497a2" returned: 0 in 0.589s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-60867fd5-281c-4846-a6c1-f8e8900497a2 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:47 devstack sudo[109973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-60867fd5-281c-4846-a6c1-f8e8900497a2
Aug 26 17:17:47 devstack sudo[109973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:48 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1" returned: 0 in 0.446s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd53904-a5a6-48bc-914f-8e53cd4d9e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f55b3fd-81d4-41d2-81c5-8ec1a3b1dff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:48 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Volume volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1 (b486afbf-f494-4ecf-9a02-103d83c6b6b1): created successfully
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f55b3fd-81d4-41d2-81c5-8ec1a3b1dff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Flow 'volume_create_manager' (ab9f1a6e-1931-4698-aa74-a010aadebfcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:48 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2c465808-acb8-4b53-ae83-d779a25aa94d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created volume successfully.
Aug 26 17:17:48 devstack sudo[109973]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-60867fd5-281c-4846-a6c1-f8e8900497a2" returned: 0 in 0.424s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Lock "cinder-quobyte-60867fd5-281c-4846-a6c1-f8e8900497a2" released by "delete_volume" :: held 1.076s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Created reservations ['2ac15daa-d472-4df3-b038-5eb35587ee03', '223a296d-0b29-4fb4-b9c7-12c408abbf5b', '1e8a84bd-525f-43f1-b7f2-b030a196f804', '1cf49727-f5f8-4b79-aa4f-7c5d6089d63f'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:48 devstack sudo[109977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:48 devstack sudo[109977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:48 devstack sudo[109977]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.388s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:48 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Deleted volume successfully.
Aug 26 17:17:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a2e1352-65c1-416e-93b8-4812a2309c1b tempest-VolumesTransfersV357Test-1104388017 None] Lock "cinder-60867fd5-281c-4846-a6c1-f8e8900497a2-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-b486afbf-f494-4ecf-9a02-103d83c6b6b1-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-b486afbf-f494-4ecf-9a02-103d83c6b6b1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-quobyte-b486afbf-f494-4ecf-9a02-103d83c6b6b1" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-b486afbf-f494-4ecf-9a02-103d83c6b6b1" acquired by "delete_volume" :: waited 0.028s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:49 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[796007ec-171e-4aa9-b326-ee98f9680ec5]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:49 devstack sudo[109980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1
Aug 26 17:17:49 devstack sudo[109980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:49 devstack sudo[109980]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1" returned: 0 in 0.598s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:49 devstack sudo[109985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1
Aug 26 17:17:49 devstack sudo[109985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:50 devstack sudo[109985]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b486afbf-f494-4ecf-9a02-103d83c6b6b1" returned: 0 in 0.729s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-b486afbf-f494-4ecf-9a02-103d83c6b6b1" released by "delete_volume" :: held 1.394s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created reservations ['a2fbd050-3934-4ea0-8d20-3bbc5ea0089a', '5a0d69b6-adcb-41ec-bac6-a6997328d7d6', 'c7f8291f-258a-4053-b55a-988d96f28f8c', 'db25e328-34f6-4739-ae8b-13d2a7fba673'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Flow 'volume_create_manager' (cef9666f-28b3-4c4a-9d7f-7d0fbf3468c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a15c34-9019-44df-9a21-d20ac7131e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a15c34-9019-44df-9a21-d20ac7131e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1318883083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1533fbdd-25e2-469d-8d40-4900bc77b585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac6ef56b3ad425c8d478f87c67a6428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:51Z,use_quota=True,user_id='413b2e84fb184c63895caabd31fd3283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:50 devstack sudo[109991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:50 devstack sudo[109991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04019ce3-3431-4398-9dda-1bb17007f67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04019ce3-3431-4398-9dda-1bb17007f67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80aaf506-7269-4fe0-ad5d-587fa84672d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80aaf506-7269-4fe0-ad5d-587fa84672d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1533fbdd-25e2-469d-8d40-4900bc77b585', 'volume_name': 'volume-1533fbdd-25e2-469d-8d40-4900bc77b585', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db17c1f-cdf8-44b8-8732-b6b28b3bd9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db17c1f-cdf8-44b8-8732-b6b28b3bd9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa17211-a424-43c5-ab98-765eba89ea96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:50 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Volume 1533fbdd-25e2-469d-8d40-4900bc77b585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1533fbdd-25e2-469d-8d40-4900bc77b585', 'volume_size': 1}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1318883083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1533fbdd-25e2-469d-8d40-4900bc77b585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac6ef56b3ad425c8d478f87c67a6428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:51Z,use_quota=True,user_id='413b2e84fb184c63895caabd31fd3283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Creating volume 1533fbdd-25e2-469d-8d40-4900bc77b585 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:50 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1533fbdd-25e2-469d-8d40-4900bc77b585 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:51 devstack sudo[109993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1533fbdd-25e2-469d-8d40-4900bc77b585 1073741824
Aug 26 17:17:51 devstack sudo[109993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:51 devstack sudo[109991]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.474s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:51 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:51 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Deleted volume successfully.
Aug 26 17:17:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c5f59523-1f9e-49c6-8aff-e18fedd5f013 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-b486afbf-f494-4ecf-9a02-103d83c6b6b1-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-6cfab189-ac24-4054-b993-fe54f580bee0-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-6cfab189-ac24-4054-b993-fe54f580bee0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-quobyte-6cfab189-ac24-4054-b993-fe54f580bee0" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-6cfab189-ac24-4054-b993-fe54f580bee0" acquired by "delete_volume" :: waited 0.031s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:51 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[076b243a-4c4f-488f-9ce0-12cf43f6d7b5]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-6cfab189-ac24-4054-b993-fe54f580bee0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:51 devstack sudo[109993]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1533fbdd-25e2-469d-8d40-4900bc77b585 1073741824" returned: 0 in 0.699s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1533fbdd-25e2-469d-8d40-4900bc77b585 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:51 devstack sudo[110000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-6cfab189-ac24-4054-b993-fe54f580bee0
Aug 26 17:17:51 devstack sudo[110000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:51 devstack sudo[110001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1533fbdd-25e2-469d-8d40-4900bc77b585
Aug 26 17:17:51 devstack sudo[110001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:52 devstack sudo[110001]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1533fbdd-25e2-469d-8d40-4900bc77b585" returned: 0 in 0.352s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa17211-a424-43c5-ab98-765eba89ea96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1533fbdd-25e2-469d-8d40-4900bc77b585', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15c8e69-a253-4b91-a32d-12de506ac952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:52 devstack sudo[110000]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:52 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Volume volume-1533fbdd-25e2-469d-8d40-4900bc77b585 (1533fbdd-25e2-469d-8d40-4900bc77b585): created successfully
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15c8e69-a253-4b91-a32d-12de506ac952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Flow 'volume_create_manager' (cef9666f-28b3-4c4a-9d7f-7d0fbf3468c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-6cfab189-ac24-4054-b993-fe54f580bee0" returned: 0 in 0.518s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-6cfab189-ac24-4054-b993-fe54f580bee0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:52 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a5804182-37ba-4327-b4d1-799693490259 tempest-VolumesTransfersV357Test-903630499 None] Created volume successfully.
Aug 26 17:17:52 devstack sudo[110008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-6cfab189-ac24-4054-b993-fe54f580bee0
Aug 26 17:17:52 devstack sudo[110008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:52 devstack sudo[110008]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-6cfab189-ac24-4054-b993-fe54f580bee0" returned: 0 in 0.281s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-6cfab189-ac24-4054-b993-fe54f580bee0" released by "delete_volume" :: held 0.863s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Flow 'volume_create_manager' (529a8de8-2ae5-4b84-888f-544e4afeafc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027cb764-6fa6-4121-a095-f1cdbc5e42e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027cb764-6fa6-4121-a095-f1cdbc5e42e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c498cd-dc1c-4835-b0b8-ed6f519c530c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a9d174b96a445bb736ae639a7f9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:52Z,use_quota=True,user_id='27c5f9dee17742d6b637d7d22de8397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01daf01a-c1fe-4ed8-a5c0-e463340e67ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01daf01a-c1fe-4ed8-a5c0-e463340e67ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f860b15-9405-49d2-9367-850e35337f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.image.glance [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Creating Keystone auth plugin from conf {{(pid=94125) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created reservations ['baa68d15-5272-49af-be15-5929b5f4ad5e', '21acdea2-56e7-4cff-8114-07795d02eafd', '69fe0fbb-1d37-4228-acff-d75cde97ce30', 'c6b2eefd-735a-4580-a314-760f5650dc54'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:52 devstack sudo[110011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:52 devstack sudo[110011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f860b15-9405-49d2-9367-850e35337f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83c498cd-dc1c-4835-b0b8-ed6f519c530c', 'volume_name': 'volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c', 'volume_size': 1, 'image_id': '312ef299-8593-4ba2-b59f-386813a41f9d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/312ef299-8593-4ba2-b59f-386813a41f9d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc4091877bb00fea285be32a9b152f54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74a9d174b96a445bb736ae639a7f9db3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '38666cda9a9a1814b6010602d51252ee3d6b094f2fe6cbdf67ea3f8f718dea6d6bc18f95932cf1231e63b73bcbc7d5b8f3e6317494cfe8b6ebfbc5b70d5e57f2', 'id': '312ef299-8593-4ba2-b59f-386813a41f9d', 'created_at': datetime.datetime(2026, 8, 26, 15, 17, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 17, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/312ef299-8593-4ba2-b59f-386813a41f9d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901f28e3950>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604f4171-5008-43fe-8f32-221a7fad769e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604f4171-5008-43fe-8f32-221a7fad769e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c38af2d-988d-4f00-bb6f-da07708260d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:52 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Volume 83c498cd-dc1c-4835-b0b8-ed6f519c530c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c', 'volume_size': 1, 'image_id': '312ef299-8593-4ba2-b59f-386813a41f9d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/312ef299-8593-4ba2-b59f-386813a41f9d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc4091877bb00fea285be32a9b152f54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74a9d174b96a445bb736ae639a7f9db3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '38666cda9a9a1814b6010602d51252ee3d6b094f2fe6cbdf67ea3f8f718dea6d6bc18f95932cf1231e63b73bcbc7d5b8f3e6317494cfe8b6ebfbc5b70d5e57f2', 'id': '312ef299-8593-4ba2-b59f-386813a41f9d', 'created_at': datetime.datetime(2026, 8, 26, 15, 17, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 17, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/312ef299-8593-4ba2-b59f-386813a41f9d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901f28e3950>}
Aug 26 17:17:52 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Trying to clone 83c498cd-dc1c-4835-b0b8-ed6f519c530c from image 312ef299-8593-4ba2-b59f-386813a41f9d at location (None, [{'url': 'file:///opt/stack/data/glance/images/312ef299-8593-4ba2-b59f-386813a41f9d', 'metadata': {}}]). {{(pid=94125) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 17:17:53 devstack sudo[110011]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.359s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:53 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Deleted volume successfully.
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 17:17:53 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Image download 0.00 MB at 0.00 MB/s
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a12c148a-64b3-4f44-8e36-9a1b8ab40430 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-6cfab189-ac24-4054-b993-fe54f580bee0-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d82fa2-8839-4ba4-9542-38a122f4e8a3]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Acquiring lock "cinder-1533fbdd-25e2-469d-8d40-4900bc77b585-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Lock "cinder-1533fbdd-25e2-469d-8d40-4900bc77b585-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Acquiring lock "cinder-quobyte-1533fbdd-25e2-469d-8d40-4900bc77b585" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Lock "cinder-quobyte-1533fbdd-25e2-469d-8d40-4900bc77b585" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:53 devstack sudo[110014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD
Aug 26 17:17:53 devstack sudo[110014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd84853-6ebd-4ba6-a093-e7bc7c0c469f]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1533fbdd-25e2-469d-8d40-4900bc77b585 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:53 devstack sudo[110017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1533fbdd-25e2-469d-8d40-4900bc77b585
Aug 26 17:17:53 devstack sudo[110017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:53 devstack sudo[110014]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:53 devstack sudo[110047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD
Aug 26 17:17:53 devstack sudo[110047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-e53bfe97-ae17-48d7-94a6-84cfb94336e0-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-e53bfe97-ae17-48d7-94a6-84cfb94336e0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:53 devstack sudo[110017]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-quobyte-e53bfe97-ae17-48d7-94a6-84cfb94336e0" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1533fbdd-25e2-469d-8d40-4900bc77b585" returned: 0 in 0.521s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1533fbdd-25e2-469d-8d40-4900bc77b585 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-e53bfe97-ae17-48d7-94a6-84cfb94336e0" acquired by "delete_volume" :: waited 0.034s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:53 devstack sudo[110052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1533fbdd-25e2-469d-8d40-4900bc77b585
Aug 26 17:17:53 devstack sudo[110052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f165c924-a2bd-4757-ae1d-e635861de10d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:54 devstack sudo[110047]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD" returned: 1 in 0.460s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Temporary image 312ef299-8593-4ba2-b59f-386813a41f9d is fetched for user 27c5f9dee17742d6b637d7d22de8397f. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f837cdd2-49f2-440d-bb9f-ee5687f74ddd]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:54 devstack sudo[110057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0
Aug 26 17:17:54 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:54 devstack sudo[110052]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1533fbdd-25e2-469d-8d40-4900bc77b585" returned: 0 in 0.313s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Lock "cinder-quobyte-1533fbdd-25e2-469d-8d40-4900bc77b585" released by "delete_volume" :: held 0.900s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:54 devstack sudo[110059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD
Aug 26 17:17:54 devstack sudo[110059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Created reservations ['0d32cd2a-6a12-4720-b8fd-1196f54b5b58', '42471a6b-7bba-4ea6-9c94-5fb6876e782b', '09a283a4-0cc4-4006-a4a7-9fada25a4b00', '5194291e-7fcc-4e93-9712-76ae48da9fa1'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:54 devstack sudo[110065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:54 devstack sudo[110065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:54 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0" returned: 0 in 0.511s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:54 devstack sudo[110067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0
Aug 26 17:17:54 devstack sudo[110067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:54 devstack sudo[110059]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:54 devstack sudo[110071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD
Aug 26 17:17:54 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:54 devstack sudo[110065]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.395s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:54 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Deleted volume successfully.
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-528489ee-a580-47ca-b814-3c9d6d6cb6a1 tempest-VolumesTransfersV357Test-1104388017 None] Lock "cinder-1533fbdd-25e2-469d-8d40-4900bc77b585-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:54 devstack sudo[110067]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e53bfe97-ae17-48d7-94a6-84cfb94336e0" returned: 0 in 0.379s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-e53bfe97-ae17-48d7-94a6-84cfb94336e0" released by "delete_volume" :: held 0.995s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:54 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created reservations ['85e5037a-5077-4029-bb52-db799cdb43ea', 'f91463de-d4f5-4790-bc1a-95c69d483c31', '4fd07952-840b-4411-8e0d-d90f34227abb', '191e6458-e8bd-448f-846d-82a957a92672'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:55 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD" returned: 1 in 0.518s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c498cd-dc1c-4835-b0b8-ed6f519c530c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a9d174b96a445bb736ae639a7f9db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:17:52Z,use_quota=True,user_id='27c5f9dee17742d6b637d7d22de8397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Creating volume 83c498cd-dc1c-4835-b0b8-ed6f519c530c {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:17:55 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:55 devstack sudo[110088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:55 devstack sudo[110088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:55 devstack sudo[110090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c 1073741824
Aug 26 17:17:55 devstack sudo[110090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:55 devstack sudo[110088]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.322s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:55 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Deleted volume successfully.
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7ed712c8-66df-4899-b970-25bbc0c23ac7 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-e53bfe97-ae17-48d7-94a6-84cfb94336e0-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:55 devstack sudo[110090]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c 1073741824" returned: 0 in 0.483s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:55 devstack sudo[110097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c
Aug 26 17:17:55 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:55 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c" returned: 0 in 0.254s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:55 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Attempting download of 312ef299-8593-4ba2-b59f-386813a41f9d ((None, [{'url': 'file:///opt/stack/data/glance/images/312ef299-8593-4ba2-b59f-386813a41f9d', 'metadata': {}}])) to volume 83c498cd-dc1c-4835-b0b8-ed6f519c530c. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc59d30-2fa1-48e4-ad42-10b344939d9b]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_312ef299-8593-4ba2-b59f-386813a41f9d_7rzd4ife {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-4baa5799-ba7b-45cf-8307-d576c271cefc-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-4baa5799-ba7b-45cf-8307-d576c271cefc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-quobyte-4baa5799-ba7b-45cf-8307-d576c271cefc" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:56 devstack sudo[110100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_312ef299-8593-4ba2-b59f-386813a41f9d_7rzd4ife
Aug 26 17:17:56 devstack sudo[110100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-4baa5799-ba7b-45cf-8307-d576c271cefc" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aae83d0-d0f4-45e3-aed5-b9405ce454d2]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4baa5799-ba7b-45cf-8307-d576c271cefc {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:56 devstack sudo[110102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4baa5799-ba7b-45cf-8307-d576c271cefc
Aug 26 17:17:56 devstack sudo[110102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:56 devstack sudo[110100]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_312ef299-8593-4ba2-b59f-386813a41f9d_7rzd4ife" returned: 0 in 0.389s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_312ef299-8593-4ba2-b59f-386813a41f9d_7rzd4ife {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:56 devstack sudo[110107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_312ef299-8593-4ba2-b59f-386813a41f9d_7rzd4ife
Aug 26 17:17:56 devstack sudo[110107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:56 devstack sudo[110102]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4baa5799-ba7b-45cf-8307-d576c271cefc" returned: 0 in 0.427s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4baa5799-ba7b-45cf-8307-d576c271cefc {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:56 devstack sudo[110112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4baa5799-ba7b-45cf-8307-d576c271cefc
Aug 26 17:17:56 devstack sudo[110112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:56 devstack sudo[110107]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_312ef299-8593-4ba2-b59f-386813a41f9d_7rzd4ife" returned: 1 in 0.393s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_312ef299-8593-4ba2-b59f-386813a41f9d_7rzd4ife' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[35af7276-986e-49f7-9462-84c3059355ff]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:56 devstack sudo[110112]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4baa5799-ba7b-45cf-8307-d576c271cefc" returned: 0 in 0.297s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:56 devstack sudo[110116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD
Aug 26 17:17:56 devstack sudo[110116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-4baa5799-ba7b-45cf-8307-d576c271cefc" released by "delete_volume" :: held 0.770s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:56 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created reservations ['1a449d0c-65ea-452a-a6e3-cf5886ad731d', '936b8d82-762c-4388-a150-20b39a36a074', '29b69647-9025-4c7c-a247-3790828b5215', 'e1db1733-afe9-4d4f-a46e-590137662fc3'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:57 devstack sudo[110119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:57 devstack sudo[110119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:57 devstack sudo[110116]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-43104730-eb2b-4181-8293-62e0fe031212-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-43104730-eb2b-4181-8293-62e0fe031212-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-quobyte-43104730-eb2b-4181-8293-62e0fe031212" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:57 devstack sudo[110123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD
Aug 26 17:17:57 devstack sudo[110123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-43104730-eb2b-4181-8293-62e0fe031212" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a0899b-0fc7-4916-81ed-97960274b084]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-43104730-eb2b-4181-8293-62e0fe031212 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:57 devstack sudo[110119]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.325s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:57 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Deleted volume successfully.
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-82b63a6f-8752-4748-ba0a-7cf88de68b7c tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-4baa5799-ba7b-45cf-8307-d576c271cefc-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:57 devstack sudo[110126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-43104730-eb2b-4181-8293-62e0fe031212
Aug 26 17:17:57 devstack sudo[110126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:57 devstack sudo[110123]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD" returned: 1 in 0.441s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] 312ef299-8593-4ba2-b59f-386813a41f9d was raw, converting to qcow2 {{(pid=94125) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:57 devstack sudo[110131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c
Aug 26 17:17:57 devstack sudo[110131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:57 devstack sudo[110126]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-43104730-eb2b-4181-8293-62e0fe031212" returned: 0 in 0.469s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-43104730-eb2b-4181-8293-62e0fe031212 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:57 devstack sudo[110138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-43104730-eb2b-4181-8293-62e0fe031212
Aug 26 17:17:57 devstack sudo[110138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:58 devstack sudo[110138]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-43104730-eb2b-4181-8293-62e0fe031212" returned: 0 in 0.267s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:58 devstack sudo[110131]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c" returned: 0 in 0.523s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_312ef299-8593-4ba2-b59f-386813a41f9d_ishervpbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:17:58 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Converted 0.00 MB image at 0.00 MB/s
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-43104730-eb2b-4181-8293-62e0fe031212" released by "delete_volume" :: held 0.820s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:58 devstack sudo[110144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c 1G
Aug 26 17:17:58 devstack sudo[110144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created reservations ['c12ef5b8-660e-4f4f-9355-81bb0ffb9d92', '918b9a89-d9b4-400b-b181-93e0494302b0', '7ed1b928-95a8-440c-a9ae-33dd0ced978d', 'e530476a-7fbf-4a40-a034-28511c728dd3'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:58 devstack sudo[110146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:17:58 devstack sudo[110146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-5911e02d-f616-44a5-a3c5-1f02bd96a733-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-5911e02d-f616-44a5-a3c5-1f02bd96a733-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-quobyte-2712cf71-97fc-405a-a92e-aacd76d86e73" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-2712cf71-97fc-405a-a92e-aacd76d86e73" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-quobyte-5911e02d-f616-44a5-a3c5-1f02bd96a733" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-5911e02d-f616-44a5-a3c5-1f02bd96a733" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Deleting offline snapshot 5911e02d-f616-44a5-a3c5-1f02bd96a733 of volume 2712cf71-97fc-405a-a92e-aacd76d86e73 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:17:58 devstack sudo[110144]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] snapshot_file for this snap is: volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c 1G" returned: 0 in 0.430s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Downloaded image 312ef299-8593-4ba2-b59f-386813a41f9d ((None, [{'url': 'file:///opt/stack/data/glance/images/312ef299-8593-4ba2-b59f-386813a41f9d', 'metadata': {}}])) to volume 83c498cd-dc1c-4835-b0b8-ed6f519c530c successfully. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Temporary image 312ef299-8593-4ba2-b59f-386813a41f9d for user 27c5f9dee17742d6b637d7d22de8397f is deleted. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Marking volume 83c498cd-dc1c-4835-b0b8-ed6f519c530c as bootable. {{(pid=94125) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5bd8b1-b874-461c-bd78-970b77e2a8c1]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:58 devstack sudo[110146]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Copying metadata from image 312ef299-8593-4ba2-b59f-386813a41f9d to 83c498cd-dc1c-4835-b0b8-ed6f519c530c. {{(pid=94125) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Creating volume glance metadata for volume 83c498cd-dc1c-4835-b0b8-ed6f519c530c backed by image 312ef299-8593-4ba2-b59f-386813a41f9d with: {'image_id': '312ef299-8593-4ba2-b59f-386813a41f9d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dc4091877bb00fea285be32a9b152f54', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94125) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.321s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:17:58 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Deleted volume successfully.
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c127532-c562-44fd-80e9-28174b6248ff tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-43104730-eb2b-4181-8293-62e0fe031212-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c38af2d-988d-4f00-bb6f-da07708260d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c', 'volume_size': 1, 'image_id': '312ef299-8593-4ba2-b59f-386813a41f9d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/312ef299-8593-4ba2-b59f-386813a41f9d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc4091877bb00fea285be32a9b152f54', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74a9d174b96a445bb736ae639a7f9db3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '38666cda9a9a1814b6010602d51252ee3d6b094f2fe6cbdf67ea3f8f718dea6d6bc18f95932cf1231e63b73bcbc7d5b8f3e6317494cfe8b6ebfbc5b70d5e57f2', 'id': '312ef299-8593-4ba2-b59f-386813a41f9d', 'created_at': datetime.datetime(2026, 8, 26, 15, 17, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 17, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/312ef299-8593-4ba2-b59f-386813a41f9d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901f28e3950>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9666017f-8e6b-4494-8bfd-c02d863b9ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:17:58 devstack sudo[110152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733
Aug 26 17:17:58 devstack sudo[110152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:58 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Volume volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c (83c498cd-dc1c-4835-b0b8-ed6f519c530c): created successfully
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9666017f-8e6b-4494-8bfd-c02d863b9ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:17:58 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Flow 'volume_create_manager' (529a8de8-2ae5-4b84-888f-544e4afeafc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:17:58 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-54c5053c-5d0c-4883-9075-1584bc40ea54 tempest-VolumeImageDependencyTests-391460916 None] Created volume successfully.
Aug 26 17:17:59 devstack sudo[110152]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733" returned: 0 in 0.445s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2712cf71-97fc-405a-a92e-aacd76d86e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Acquiring lock "cinder-83c498cd-dc1c-4835-b0b8-ed6f519c530c-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f872b6cf-12e7-488d-8031-d3da3ca02c82]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Lock "cinder-83c498cd-dc1c-4835-b0b8-ed6f519c530c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Acquiring lock "cinder-quobyte-83c498cd-dc1c-4835-b0b8-ed6f519c530c" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Lock "cinder-quobyte-83c498cd-dc1c-4835-b0b8-ed6f519c530c" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfda9e66-221d-4820-92e0-bcf7ef78dd09]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:59 devstack sudo[110157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73
Aug 26 17:17:59 devstack sudo[110157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:59 devstack sudo[110158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c
Aug 26 17:17:59 devstack sudo[110158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:59 devstack sudo[110157]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73" returned: 0 in 0.422s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:59 devstack sudo[110166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733
Aug 26 17:17:59 devstack sudo[110166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:59 devstack sudo[110158]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c" returned: 0 in 0.397s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:59 devstack sudo[110169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c
Aug 26 17:17:59 devstack sudo[110169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:59 devstack sudo[110169]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:59 devstack sudo[110166]: pam_unix(sudo:session): session closed for user root
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-83c498cd-dc1c-4835-b0b8-ed6f519c530c" returned: 0 in 0.299s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733" returned: 0 in 0.396s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Lock "cinder-quobyte-83c498cd-dc1c-4835-b0b8-ed6f519c530c" released by "delete_volume" :: held 0.753s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:17:59 devstack sudo[110175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733
Aug 26 17:17:59 devstack sudo[110175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:17:59 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Created reservations ['f945f686-1d1a-407c-8215-c1792f34be71', 'e72274b0-aba9-41a0-9c93-777f807683e9', '1856c03b-a567-40d5-8c85-e2b5ed345a66', '8c5be00c-d41b-494a-9c7b-8eb9181db9b7'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:00 devstack sudo[110177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:00 devstack sudo[110177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:00 devstack sudo[110175]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73.5911e02d-f616-44a5-a3c5-1f02bd96a733" returned: 0 in 0.296s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-5911e02d-f616-44a5-a3c5-1f02bd96a733" released by "_delete_snapshot" :: held 1.706s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-2712cf71-97fc-405a-a92e-aacd76d86e73" released by "delete_snapshot" :: held 1.744s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:00 devstack sudo[110177]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.298s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created reservations ['a8237f16-87c2-4720-ac6b-69899d488184', '84adb804-1a1e-4e8a-8479-3ae730c11824', 'ecc2a0c2-aa37-4264-a3c8-27f3d960a88d', '9ca7794f-f086-4ba4-b118-6e5a4acae708'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:00 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Deleted volume successfully.
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0afe69ec-8326-4a6e-ba8b-4c6e48eebd4c tempest-VolumeImageDependencyTests-391460916 None] Lock "cinder-83c498cd-dc1c-4835-b0b8-ed6f519c530c-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:00 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Delete snapshot completed successfully.
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-41d3b877-4058-4ccd-aabc-db7ad006ab8d tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-5911e02d-f616-44a5-a3c5-1f02bd96a733-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-2712cf71-97fc-405a-a92e-aacd76d86e73-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-2712cf71-97fc-405a-a92e-aacd76d86e73-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "cinder-quobyte-2712cf71-97fc-405a-a92e-aacd76d86e73" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-2712cf71-97fc-405a-a92e-aacd76d86e73" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a6108c-63e3-4bb8-995d-4094a12576e7]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:00 devstack sudo[110181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73
Aug 26 17:18:00 devstack sudo[110181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Flow 'volume_create_manager' (e8c24b20-dcab-4a3b-828f-4aafffdc8a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc696004-72ba-45e5-b33e-caa92f17fa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc696004-72ba-45e5-b33e-caa92f17fa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-359525665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbc7397-06f2-4ba0-a377-a2898aa05382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f2eec923a74982a3514d8a0636be49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:01Z,use_quota=True,user_id='99602ea7fcc14e1386861cd24e7772aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81f9d77-6aa1-4023-9dcf-eaf78eaae876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81f9d77-6aa1-4023-9dcf-eaf78eaae876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0614bbb1-79a1-4cec-b760-09a68349a500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.image.glance [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Creating Keystone auth plugin from conf {{(pid=94125) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 17:18:01 devstack sudo[110181]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73" returned: 0 in 0.402s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:01 devstack sudo[110186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73
Aug 26 17:18:01 devstack sudo[110186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:01 devstack sudo[110186]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2712cf71-97fc-405a-a92e-aacd76d86e73" returned: 0 in 0.290s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-quobyte-2712cf71-97fc-405a-a92e-aacd76d86e73" released by "delete_volume" :: held 0.776s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0614bbb1-79a1-4cec-b760-09a68349a500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bcbc7397-06f2-4ba0-a377-a2898aa05382', 'volume_name': 'volume-bcbc7397-06f2-4ba0-a377-a2898aa05382', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd0974a0>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf96624-6712-4872-bfc0-4dfaf5c73867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf96624-6712-4872-bfc0-4dfaf5c73867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a76c76a-3d73-4196-bf62-d05268111f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:01 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Volume bcbc7397-06f2-4ba0-a377-a2898aa05382: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bcbc7397-06f2-4ba0-a377-a2898aa05382', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd0974a0>}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Trying to clone bcbc7397-06f2-4ba0-a377-a2898aa05382 from image b24297bc-5b4d-44da-a168-9014960429c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]). {{(pid=94125) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Created reservations ['22f85822-2b95-4984-ad04-42969f245027', 'dc5aac12-ff5d-4287-9566-089fa6be34fe', '6567fa9b-6b31-4d65-b19e-221aa7b1efa2', '962ea6fb-b0d9-4331-8443-c8b5d157f9db'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:01 devstack sudo[110189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:01 devstack sudo[110189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:02 devstack sudo[110189]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.314s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:02 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:02 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Deleted volume successfully.
Aug 26 17:18:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8bc4a506-67d4-4982-9a3f-187583abdd77 tempest-CreateVolumesFromSnapshotTest-1070409126 None] Lock "cinder-2712cf71-97fc-405a-a92e-aacd76d86e73-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:02 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 17:18:02 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Image download 20.69 MB at 20.69 MB/s
Aug 26 17:18:02 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fea528-d624-46f7-9621-616bdf9bfc85]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:02 devstack sudo[110193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD
Aug 26 17:18:02 devstack sudo[110193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:02 devstack sudo[110193]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:02 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Temporary image b24297bc-5b4d-44da-a168-9014960429c1 is fetched for user 99602ea7fcc14e1386861cd24e7772aa. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 17:18:02 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=167,cinder:UPDATE=203,cinder:INSERT=54,cinder:DELETE=14 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:18:02 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=152,cinder:UPDATE=211,cinder:INSERT=56,cinder:DELETE=23 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:18:02 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[21df6c0b-2234-483d-bc74-3fedb770586f]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:02 devstack sudo[110198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD
Aug 26 17:18:02 devstack sudo[110198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:03 devstack sudo[110198]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD" returned: 0 in 0.505s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-359525665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbc7397-06f2-4ba0-a377-a2898aa05382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f2eec923a74982a3514d8a0636be49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:01Z,use_quota=True,user_id='99602ea7fcc14e1386861cd24e7772aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Creating volume bcbc7397-06f2-4ba0-a377-a2898aa05382 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:18:03 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:03 devstack sudo[110203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 1073741824
Aug 26 17:18:03 devstack sudo[110203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:03 devstack sudo[110203]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 1073741824" returned: 0 in 0.777s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:04 devstack sudo[110209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382
Aug 26 17:18:04 devstack sudo[110209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:04 devstack sudo[110209]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382" returned: 0 in 0.432s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Flow 'volume_create_manager' (41e30005-5792-46a0-b91c-09ebefbd7a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2b1c9e-a408-4913-aaff-e44d69a7c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Attempting download of b24297bc-5b4d-44da-a168-9014960429c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}])) to volume bcbc7397-06f2-4ba0-a377-a2898aa05382. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2b1c9e-a408-4913-aaff-e44d69a7c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0af063d-caee-42bf-b430-7232165f2c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c37dad8b555476a81d89bad529a84a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:04Z,use_quota=True,user_id='ed07d911492f4e36a84acdeb36ba308e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c740d82e-10d2-42de-9bd4-0736de8aee4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c740d82e-10d2-42de-9bd4-0736de8aee4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd71c149-6d57-49af-9567-4aa949edf9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd71c149-6d57-49af-9567-4aa949edf9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0af063d-caee-42bf-b430-7232165f2c1a', 'volume_name': 'volume-d0af063d-caee-42bf-b430-7232165f2c1a', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90bfc00-fe38-4c34-96ba-7ebe85b25906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90bfc00-fe38-4c34-96ba-7ebe85b25906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e14cd85-dfa2-4b33-b3e7-1dfea35399da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:04 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Volume d0af063d-caee-42bf-b430-7232165f2c1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0af063d-caee-42bf-b430-7232165f2c1a', 'volume_size': 1}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0af063d-caee-42bf-b430-7232165f2c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c37dad8b555476a81d89bad529a84a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:04Z,use_quota=True,user_id='ed07d911492f4e36a84acdeb36ba308e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Creating volume d0af063d-caee-42bf-b430-7232165f2c1a {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:18:04 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d0af063d-caee-42bf-b430-7232165f2c1a 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35f352d-6fb0-448a-9bed-6bafa93db1d4]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_18dyk6__ {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:04 devstack sudo[110215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d0af063d-caee-42bf-b430-7232165f2c1a 1073741824
Aug 26 17:18:04 devstack sudo[110215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:04 devstack sudo[110216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_18dyk6__
Aug 26 17:18:04 devstack sudo[110216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:05 devstack sudo[110216]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_18dyk6__" returned: 0 in 0.383s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_18dyk6__ {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:05 devstack sudo[110224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_18dyk6__
Aug 26 17:18:05 devstack sudo[110224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:05 devstack sudo[110215]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d0af063d-caee-42bf-b430-7232165f2c1a 1073741824" returned: 0 in 0.564s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d0af063d-caee-42bf-b430-7232165f2c1a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:05 devstack sudo[110227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d0af063d-caee-42bf-b430-7232165f2c1a
Aug 26 17:18:05 devstack sudo[110227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:05 devstack sudo[110224]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_18dyk6__" returned: 1 in 0.408s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b24297bc-5b4d-44da-a168-9014960429c1_18dyk6__' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[9731c1f7-0e24-4abe-9408-11eeefe9a7b8]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:05 devstack sudo[110231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD
Aug 26 17:18:05 devstack sudo[110231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:05 devstack sudo[110227]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d0af063d-caee-42bf-b430-7232165f2c1a" returned: 0 in 0.384s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e14cd85-dfa2-4b33-b3e7-1dfea35399da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0af063d-caee-42bf-b430-7232165f2c1a', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82efeab8-233b-40c5-b8b6-e92977bd6f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:05 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Volume volume-d0af063d-caee-42bf-b430-7232165f2c1a (d0af063d-caee-42bf-b430-7232165f2c1a): created successfully
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82efeab8-233b-40c5-b8b6-e92977bd6f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Flow 'volume_create_manager' (41e30005-5792-46a0-b91c-09ebefbd7a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:05 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-411a9388-0347-4d03-9128-1fef03e3c82f tempest-CinderUnicodeTest-1805625412 None] Created volume successfully.
Aug 26 17:18:05 devstack sudo[110231]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] b24297bc-5b4d-44da-a168-9014960429c1 was qcow2, converting to qcow2 {{(pid=94125) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 17:18:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:05 devstack sudo[110237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382
Aug 26 17:18:05 devstack sudo[110237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Flow 'volume_create_manager' (fa9db3fd-ed43-4852-819a-dcb29255a6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2419b587-6ac4-48f0-8bf4-5e2ee057bec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2419b587-6ac4-48f0-8bf4-5e2ee057bec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1505049255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7590db0e-31fc-49d2-863f-e3e4befc6571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c37dad8b555476a81d89bad529a84a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:07Z,use_quota=True,user_id='ed07d911492f4e36a84acdeb36ba308e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ac9bba-7aa5-4be4-a514-702d995dabf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ac9bba-7aa5-4be4-a514-702d995dabf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52186439-590d-4949-a8db-011295ce0d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52186439-590d-4949-a8db-011295ce0d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7590db0e-31fc-49d2-863f-e3e4befc6571', 'volume_name': 'volume-7590db0e-31fc-49d2-863f-e3e4befc6571', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b857aab-2ebd-4740-9578-3f15f7871455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b857aab-2ebd-4740-9578-3f15f7871455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73bb1bb9-31f3-47cd-9667-c0ebe5db4495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:07 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Volume 7590db0e-31fc-49d2-863f-e3e4befc6571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7590db0e-31fc-49d2-863f-e3e4befc6571', 'volume_size': 1}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1505049255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7590db0e-31fc-49d2-863f-e3e4befc6571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c37dad8b555476a81d89bad529a84a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:07Z,use_quota=True,user_id='ed07d911492f4e36a84acdeb36ba308e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Creating volume 7590db0e-31fc-49d2-863f-e3e4befc6571 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:18:07 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:07 devstack sudo[110246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571 1073741824
Aug 26 17:18:07 devstack sudo[110246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:07 devstack sudo[110246]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571 1073741824" returned: 0 in 0.504s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:08 devstack sudo[110237]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382" returned: 0 in 2.162s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b24297bc-5b4d-44da-a168-9014960429c1_esfk72x1devstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:18:08 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Converted 112.00 MB image at 51.76 MB/s
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:08 devstack sudo[110252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571
Aug 26 17:18:08 devstack sudo[110252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:08 devstack sudo[110253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 1G
Aug 26 17:18:08 devstack sudo[110253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:08 devstack sudo[110252]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571" returned: 0 in 0.274s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73bb1bb9-31f3-47cd-9667-c0ebe5db4495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7590db0e-31fc-49d2-863f-e3e4befc6571', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5e6430-866a-4d81-af81-65be8dca6e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:08 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Volume volume-7590db0e-31fc-49d2-863f-e3e4befc6571 (7590db0e-31fc-49d2-863f-e3e4befc6571): created successfully
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5e6430-866a-4d81-af81-65be8dca6e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Flow 'volume_create_manager' (fa9db3fd-ed43-4852-819a-dcb29255a6c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:08 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f0e88346-fbd7-483a-888b-92a6b000803d tempest-CinderUnicodeTest-1805625412 None] Created volume successfully.
Aug 26 17:18:08 devstack sudo[110253]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 1G" returned: 0 in 0.366s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Downloaded image b24297bc-5b4d-44da-a168-9014960429c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}])) to volume bcbc7397-06f2-4ba0-a377-a2898aa05382 successfully. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Temporary image b24297bc-5b4d-44da-a168-9014960429c1 for user 99602ea7fcc14e1386861cd24e7772aa is deleted. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Marking volume bcbc7397-06f2-4ba0-a377-a2898aa05382 as bootable. {{(pid=94125) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Copying metadata from image b24297bc-5b4d-44da-a168-9014960429c1 to bcbc7397-06f2-4ba0-a377-a2898aa05382. {{(pid=94125) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Creating volume glance metadata for volume bcbc7397-06f2-4ba0-a377-a2898aa05382 backed by image b24297bc-5b4d-44da-a168-9014960429c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94125) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a76c76a-3d73-4196-bf62-d05268111f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbc7397-06f2-4ba0-a377-a2898aa05382', 'volume_size': 1, 'image_id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b24297bc-5b4d-44da-a168-9014960429c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6a5ce96e55744bea4e10d6066949d39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b24297bc-5b4d-44da-a168-9014960429c1', 'created_at': datetime.datetime(2026, 8, 26, 14, 59, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 59, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b24297bc-5b4d-44da-a168-9014960429c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd0974a0>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e869e0-ba16-4406-8a93-5852f5d2be3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:08 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Volume volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 (bcbc7397-06f2-4ba0-a377-a2898aa05382): created successfully
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e869e0-ba16-4406-8a93-5852f5d2be3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Flow 'volume_create_manager' (e8c24b20-dcab-4a3b-828f-4aafffdc8a29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:08 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c4021555-de9d-4ee8-832a-5ab2b490f01f tempest-VolumesExtendTest-234851192 None] Created volume successfully.
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-533f0d4e-8873-416f-a224-7169561f48a6 tempest-VolumesExtendTest-234851192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-533f0d4e-8873-416f-a224-7169561f48a6 tempest-VolumesExtendTest-234851192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[35aec713-250c-4775-8da2-d2dfc2277e61]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-533f0d4e-8873-416f-a224-7169561f48a6 tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:08 devstack sudo[110261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382
Aug 26 17:18:08 devstack sudo[110261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:09 devstack sudo[110261]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-533f0d4e-8873-416f-a224-7169561f48a6 tempest-VolumesExtendTest-234851192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382" returned: 0 in 0.372s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-533f0d4e-8873-416f-a224-7169561f48a6 tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 2G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-533f0d4e-8873-416f-a224-7169561f48a6 tempest-VolumesExtendTest-234851192 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 2G" returned: 0 in 0.104s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-533f0d4e-8873-416f-a224-7169561f48a6 tempest-VolumesExtendTest-234851192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.503s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:09 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-533f0d4e-8873-416f-a224-7169561f48a6 tempest-VolumesExtendTest-234851192 None] Extend volume completed successfully.
Aug 26 17:18:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] Creating offline snapshot 88c683c9-048a-4ba6-a1ef-bbb775812937 of volume 7590db0e-31fc-49d2-863f-e3e4befc6571 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:18:09 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[083413da-1060-44f2-b5f4-1e4db02871ef]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:09 devstack sudo[110270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571
Aug 26 17:18:09 devstack sudo[110270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:10 devstack sudo[110270]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571" returned: 0 in 0.381s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:10 devstack sudo[110275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937 1G
Aug 26 17:18:10 devstack sudo[110275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Acquiring lock "cinder-bcbc7397-06f2-4ba0-a377-a2898aa05382-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Lock "cinder-bcbc7397-06f2-4ba0-a377-a2898aa05382-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Acquiring lock "cinder-quobyte-bcbc7397-06f2-4ba0-a377-a2898aa05382" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Lock "cinder-quobyte-bcbc7397-06f2-4ba0-a377-a2898aa05382" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[70765913-025e-455e-bf32-6aa0f7b0b1bf]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:10 devstack sudo[110278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382
Aug 26 17:18:10 devstack sudo[110278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:10 devstack sudo[110275]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937 1G" returned: 0 in 0.456s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7590db0e-31fc-49d2-863f-e3e4befc6571 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:10 devstack sudo[110285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7590db0e-31fc-49d2-863f-e3e4befc6571 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937
Aug 26 17:18:10 devstack sudo[110285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:10 devstack sudo[110278]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382" returned: 0 in 0.403s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:10 devstack sudo[110292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382
Aug 26 17:18:10 devstack sudo[110292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:10 devstack sudo[110285]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7590db0e-31fc-49d2-863f-e3e4befc6571 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937" returned: 0 in 0.348s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:10 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937 is being set with open permissions: ugo+rw
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:10 devstack sudo[110300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937
Aug 26 17:18:10 devstack sudo[110300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:10 devstack sudo[110292]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bcbc7397-06f2-4ba0-a377-a2898aa05382" returned: 0 in 0.298s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Lock "cinder-quobyte-bcbc7397-06f2-4ba0-a377-a2898aa05382" released by "delete_volume" :: held 0.743s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Created reservations ['7017d181-cdd0-4f8d-848d-85af8f3e70a5', '921859fe-7895-4f4b-b78e-224ec95045c9', '72d6628e-1372-40ff-92b3-7303320e35b6', 'c3b6651e-d855-464a-b09f-cca3e9a0b6ad'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:11 devstack sudo[110300]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937" returned: 0 in 0.279s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:11 devstack sudo[110304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:11 devstack sudo[110304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:11 devstack sudo[110306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.info
Aug 26 17:18:11 devstack sudo[110306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:11 devstack sudo[110304]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.284s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:11 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Deleted volume successfully.
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-62513bcf-eadb-4bdf-9546-29407ab19155 tempest-VolumesExtendTest-234851192 None] Lock "cinder-bcbc7397-06f2-4ba0-a377-a2898aa05382-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:11 devstack sudo[110306]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.info" returned: 0 in 0.321s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:11 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.info is being set with open permissions: ugo+rw
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:11 devstack sudo[110310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.info
Aug 26 17:18:11 devstack sudo[110310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:11 devstack sudo[110310]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.info" returned: 0 in 0.341s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-0f6f86f0-f76e-4c05-90dc-f21baa1751a2 req-90cdc9a4-5fc8-4f85-aff7-bf06eeb14bdc tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-0f6f86f0-f76e-4c05-90dc-f21baa1751a2 req-90cdc9a4-5fc8-4f85-aff7-bf06eeb14bdc tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:11 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-3a2104f7-1321-46b3-95d4-08a4b2283995 tempest-CinderUnicodeTest-1805625412 None] Create snapshot completed successfully
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-0f6f86f0-f76e-4c05-90dc-f21baa1751a2 req-90cdc9a4-5fc8-4f85-aff7-bf06eeb14bdc tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Flow 'volume_create_manager' (01616e84-bad3-4b2c-a8d9-4937077bff00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e8f360-87da-4b2b-99e6-ba4389e22072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e8f360-87da-4b2b-99e6-ba4389e22072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1582375689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a1e703-ad84-4a75-b418-c70efc5d5943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f2eec923a74982a3514d8a0636be49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:12Z,use_quota=True,user_id='99602ea7fcc14e1386861cd24e7772aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124ef0a3-0d36-461c-af25-7027ba7ae8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124ef0a3-0d36-461c-af25-7027ba7ae8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be279146-0d54-4289-af02-d97c5999c6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be279146-0d54-4289-af02-d97c5999c6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a1e703-ad84-4a75-b418-c70efc5d5943', 'volume_name': 'volume-c6a1e703-ad84-4a75-b418-c70efc5d5943', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f67510-bcb3-402c-94d3-306c2a8e53a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f67510-bcb3-402c-94d3-306c2a8e53a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed7cb0e-0a5e-4953-8d3a-d8792c113e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Volume c6a1e703-ad84-4a75-b418-c70efc5d5943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a1e703-ad84-4a75-b418-c70efc5d5943', 'volume_size': 1}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1582375689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a1e703-ad84-4a75-b418-c70efc5d5943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f2eec923a74982a3514d8a0636be49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:12Z,use_quota=True,user_id='99602ea7fcc14e1386861cd24e7772aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Creating volume c6a1e703-ad84-4a75-b418-c70efc5d5943 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:18:12 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-0f6f86f0-f76e-4c05-90dc-f21baa1751a2 req-90cdc9a4-5fc8-4f85-aff7-bf06eeb14bdc tempest-TestInstancesWithCinderVolumes-7102684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-4353d6a9-d30f-43a1-b738-1b430eae57f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea49fefe-abe2-4ad1-a6c5-af7889a8aaca', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:18:12 devstack sudo[110321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 1073741824
Aug 26 17:18:12 devstack sudo[110321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:12 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-0f6f86f0-f76e-4c05-90dc-f21baa1751a2 req-90cdc9a4-5fc8-4f85-aff7-bf06eeb14bdc tempest-TestInstancesWithCinderVolumes-7102684 None] attachment_update completed successfully.
Aug 26 17:18:12 devstack sudo[110321]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 1073741824" returned: 0 in 0.437s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:12 devstack sudo[110332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943
Aug 26 17:18:12 devstack sudo[110332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:12 devstack sudo[110332]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "cinder-88c683c9-048a-4ba6-a1ef-bbb775812937-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943" returned: 0 in 0.318s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed7cb0e-0a5e-4953-8d3a-d8792c113e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a1e703-ad84-4a75-b418-c70efc5d5943', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ed6ace-f12c-44a0-ae73-b3744dbe8e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-88c683c9-048a-4ba6-a1ef-bbb775812937-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "cinder-quobyte-7590db0e-31fc-49d2-863f-e3e4befc6571" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Volume volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 (c6a1e703-ad84-4a75-b418-c70efc5d5943): created successfully
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ed6ace-f12c-44a0-ae73-b3744dbe8e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Flow 'volume_create_manager' (01616e84-bad3-4b2c-a8d9-4937077bff00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-quobyte-7590db0e-31fc-49d2-863f-e3e4befc6571" acquired by "delete_snapshot" :: waited 0.042s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "cinder-quobyte-88c683c9-048a-4ba6-a1ef-bbb775812937" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:12 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-cc9c0271-695c-49e0-9746-1461e7f3c024 tempest-VolumesExtendTest-234851192 None] Created volume successfully.
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-quobyte-88c683c9-048a-4ba6-a1ef-bbb775812937" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Deleting offline snapshot 88c683c9-048a-4ba6-a1ef-bbb775812937 of volume 7590db0e-31fc-49d2-863f-e3e4befc6571 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] snapshot_file for this snap is: volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88a2fc0-4980-4c1b-b916-0873566a7865]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:13 devstack sudo[110335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937
Aug 26 17:18:13 devstack sudo[110335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:13 devstack sudo[110335]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937" returned: 0 in 0.347s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7590db0e-31fc-49d2-863f-e3e4befc6571(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:18:13 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[52521c2c-e105-4ae2-b00d-d1d722932d59]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:13 devstack sudo[110340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571
Aug 26 17:18:13 devstack sudo[110340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:13 devstack sudo[110340]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571" returned: 0 in 0.360s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:13 devstack sudo[110345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937
Aug 26 17:18:13 devstack sudo[110345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:14 devstack sudo[110345]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937" returned: 0 in 0.374s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:14 devstack sudo[110356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937
Aug 26 17:18:14 devstack sudo[110356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] Creating offline snapshot 4959bf5e-fae6-45b8-9a1a-19f36be6a529 of volume c6a1e703-ad84-4a75-b418-c70efc5d5943 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[c880ce8c-2f05-4bd4-8538-18b2535abade]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:14 devstack sudo[110356]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571.88c683c9-048a-4ba6-a1ef-bbb775812937" returned: 0 in 0.317s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:14 devstack sudo[110360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943
Aug 26 17:18:14 devstack sudo[110360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-quobyte-88c683c9-048a-4ba6-a1ef-bbb775812937" released by "_delete_snapshot" :: held 1.511s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-quobyte-7590db0e-31fc-49d2-863f-e3e4befc6571" released by "delete_snapshot" :: held 1.539s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Created reservations ['54338761-12d5-429f-9a42-e617eedc4b75', '2d3668f3-80ee-40db-a7d4-ee0caceeee00', 'd519c007-d984-4602-9fe6-284820342755', '5362d2e4-8399-4e16-9305-5092066be28f'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:14 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Delete snapshot completed successfully.
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c4a47a3e-4c07-4bed-b6c9-ae4f0d1de7a8 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-88c683c9-048a-4ba6-a1ef-bbb775812937-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:14 devstack sudo[110360]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943" returned: 0 in 0.408s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:14 devstack sudo[110369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529 1G
Aug 26 17:18:14 devstack sudo[110369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "cinder-7590db0e-31fc-49d2-863f-e3e4befc6571-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-7590db0e-31fc-49d2-863f-e3e4befc6571-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-198e85f2-d45c-4f37-869d-b510b0e19caa req-b3e611a9-e626-4469-9132-c7ff591c4fc4 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "cinder-quobyte-7590db0e-31fc-49d2-863f-e3e4befc6571" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-quobyte-7590db0e-31fc-49d2-863f-e3e4befc6571" acquired by "delete_volume" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31ca852-12cd-4dc1-9bb8-39df08bb1aa5]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:15 devstack sudo[110369]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529 1G" returned: 0 in 0.459s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:15 devstack sudo[110385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529
Aug 26 17:18:15 devstack sudo[110385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:15 devstack sudo[110384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571
Aug 26 17:18:15 devstack sudo[110384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:15 devstack sudo[110385]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529" returned: 0 in 0.289s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:15 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529 is being set with open permissions: ugo+rw
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:15 devstack sudo[110394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529
Aug 26 17:18:15 devstack sudo[110394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:15 devstack sudo[110384]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571" returned: 0 in 0.371s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:15 devstack sudo[110396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571
Aug 26 17:18:15 devstack sudo[110396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:15 devstack sudo[110394]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529" returned: 0 in 0.252s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:15 devstack sudo[110396]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7590db0e-31fc-49d2-863f-e3e4befc6571" returned: 0 in 0.256s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:15 devstack sudo[110400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.info
Aug 26 17:18:15 devstack sudo[110400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-quobyte-7590db0e-31fc-49d2-863f-e3e4befc6571" released by "delete_volume" :: held 0.683s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Created reservations ['35325f91-9568-466a-969c-a331cfc15eba', '5f1d81c3-b146-4674-8855-05c06890014d', '8eb28d79-bb27-4d36-8235-860179d2a965', '057b4533-a21b-4e31-b8e9-4577b9e07b25'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:15 devstack sudo[110402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:15 devstack sudo[110402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:16 devstack sudo[110400]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.info" returned: 0 in 0.253s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:16 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.info is being set with open permissions: ugo+rw
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:16 devstack sudo[110405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.info
Aug 26 17:18:16 devstack sudo[110405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:16 devstack sudo[110402]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.247s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:16 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Deleted volume successfully.
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "cinder-d0af063d-caee-42bf-b430-7232165f2c1a-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a38e7905-a2e9-4dec-bc6a-f8534d1bc6f9 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-7590db0e-31fc-49d2-863f-e3e4befc6571-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-d0af063d-caee-42bf-b430-7232165f2c1a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "cinder-quobyte-d0af063d-caee-42bf-b430-7232165f2c1a" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:16 devstack sudo[110405]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.info" returned: 0 in 0.263s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-quobyte-d0af063d-caee-42bf-b430-7232165f2c1a" acquired by "delete_volume" :: waited 0.033s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-198e85f2-d45c-4f37-869d-b510b0e19caa req-b3e611a9-e626-4469-9132-c7ff591c4fc4 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.247s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed96e9be-eb58-45b0-929c-691b75ed319d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d0af063d-caee-42bf-b430-7232165f2c1a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-198e85f2-d45c-4f37-869d-b510b0e19caa req-b3e611a9-e626-4469-9132-c7ff591c4fc4 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:16 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a0766928-9d09-4d35-ba45-1342010f594d tempest-VolumesExtendTest-234851192 None] Create snapshot completed successfully
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-198e85f2-d45c-4f37-869d-b510b0e19caa req-b3e611a9-e626-4469-9132-c7ff591c4fc4 tempest-TestInstancesWithCinderVolumes-7102684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-1688b1bb-ed43-46de-820c-3af7bae8450a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1431f22a-6b4a-41b5-9340-62ecbaaf79cb', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:18:16 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-198e85f2-d45c-4f37-869d-b510b0e19caa req-b3e611a9-e626-4469-9132-c7ff591c4fc4 tempest-TestInstancesWithCinderVolumes-7102684 None] attachment_update completed successfully.
Aug 26 17:18:16 devstack sudo[110410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d0af063d-caee-42bf-b430-7232165f2c1a
Aug 26 17:18:16 devstack sudo[110410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:16 devstack sudo[110410]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d0af063d-caee-42bf-b430-7232165f2c1a" returned: 0 in 0.402s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d0af063d-caee-42bf-b430-7232165f2c1a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:16 devstack sudo[110420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d0af063d-caee-42bf-b430-7232165f2c1a
Aug 26 17:18:16 devstack sudo[110420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:16 devstack sudo[110420]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d0af063d-caee-42bf-b430-7232165f2c1a" returned: 0 in 0.261s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-quobyte-d0af063d-caee-42bf-b430-7232165f2c1a" released by "delete_volume" :: held 0.718s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Created reservations ['387bd3ff-a707-4144-8833-1d0a3065a027', 'dca9b17a-0b1a-47e4-8206-86fae8dd7cbb', 'bbc3a98e-0959-45d7-8f99-2a50035b6413', '6c5b2f40-acc0-4b8c-965e-43d72ed58e4b'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:17 devstack sudo[110423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:17 devstack sudo[110423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:17 devstack sudo[110423]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.257s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:17 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Deleted volume successfully.
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3b6dd1d6-d364-4b10-b88c-ba33a438f1c7 tempest-CinderUnicodeTest-1805625412 None] Lock "cinder-d0af063d-caee-42bf-b430-7232165f2c1a-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a889ee6d-0ed8-48a0-9c38-0e040fead22c tempest-VolumesExtendTest-234851192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a889ee6d-0ed8-48a0-9c38-0e040fead22c tempest-VolumesExtendTest-234851192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b886cec8-1fe8-49e4-be68-8a943f21d2b0]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a889ee6d-0ed8-48a0-9c38-0e040fead22c tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:17 devstack sudo[110426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943
Aug 26 17:18:17 devstack sudo[110426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:17 devstack sudo[110426]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a889ee6d-0ed8-48a0-9c38-0e040fead22c tempest-VolumesExtendTest-234851192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943" returned: 0 in 0.407s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a889ee6d-0ed8-48a0-9c38-0e040fead22c tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529 2G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a889ee6d-0ed8-48a0-9c38-0e040fead22c tempest-VolumesExtendTest-234851192 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529 2G" returned: 0 in 0.204s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a889ee6d-0ed8-48a0-9c38-0e040fead22c tempest-VolumesExtendTest-234851192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.662s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:18 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a889ee6d-0ed8-48a0-9c38-0e040fead22c tempest-VolumesExtendTest-234851192 None] Extend volume completed successfully.
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Acquiring lock "cinder-4959bf5e-fae6-45b8-9a1a-19f36be6a529-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Lock "cinder-4959bf5e-fae6-45b8-9a1a-19f36be6a529-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Acquiring lock "cinder-quobyte-c6a1e703-ad84-4a75-b418-c70efc5d5943" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Lock "cinder-quobyte-c6a1e703-ad84-4a75-b418-c70efc5d5943" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Acquiring lock "cinder-quobyte-4959bf5e-fae6-45b8-9a1a-19f36be6a529" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Lock "cinder-quobyte-4959bf5e-fae6-45b8-9a1a-19f36be6a529" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Deleting offline snapshot 4959bf5e-fae6-45b8-9a1a-19f36be6a529 of volume c6a1e703-ad84-4a75-b418-c70efc5d5943 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] snapshot_file for this snap is: volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2002a7b-db6a-44c4-952b-7039bc57f9fd]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:19 devstack sudo[110443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529
Aug 26 17:18:19 devstack sudo[110443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:19 devstack sudo[110443]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529" returned: 0 in 0.417s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6a1e703-ad84-4a75-b418-c70efc5d5943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:18:19 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[403f3296-a80e-4e92-b9f1-da2eb18d14c6]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:19 devstack sudo[110448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943
Aug 26 17:18:19 devstack sudo[110448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:19 devstack sudo[110448]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943" returned: 0 in 0.410s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:19 devstack sudo[110453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529
Aug 26 17:18:19 devstack sudo[110453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:20 devstack sudo[110453]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529" returned: 0 in 0.402s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:20 devstack sudo[110458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529
Aug 26 17:18:20 devstack sudo[110458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:20 devstack sudo[110458]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943.4959bf5e-fae6-45b8-9a1a-19f36be6a529" returned: 0 in 0.284s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Lock "cinder-quobyte-4959bf5e-fae6-45b8-9a1a-19f36be6a529" released by "_delete_snapshot" :: held 1.642s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Lock "cinder-quobyte-c6a1e703-ad84-4a75-b418-c70efc5d5943" released by "delete_snapshot" :: held 1.667s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:20 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Created reservations ['4f68de8f-a1ad-44cf-9067-dd3f894180c4', '29175929-8b1c-4b5d-8a13-b897c58fe4b1', 'c1fb59c3-99a0-4129-a8f4-e8062bd6c334', '8fdb5a0b-5bbd-484e-b957-490fc67b492c'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:20 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Delete snapshot completed successfully.
Aug 26 17:18:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6756da98-4ffd-40cb-9796-3f5e3e984594 tempest-VolumesExtendTest-234851192 None] Lock "cinder-4959bf5e-fae6-45b8-9a1a-19f36be6a529-delete_snapshot" released by "delete_snapshot" :: held 1.820s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Acquiring lock "cinder-c6a1e703-ad84-4a75-b418-c70efc5d5943-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Lock "cinder-c6a1e703-ad84-4a75-b418-c70efc5d5943-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Acquiring lock "cinder-quobyte-c6a1e703-ad84-4a75-b418-c70efc5d5943" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Lock "cinder-quobyte-c6a1e703-ad84-4a75-b418-c70efc5d5943" acquired by "delete_volume" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:21 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b04a5d-d749-4a10-a457-437dcf908dcf]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:21 devstack sudo[110480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943
Aug 26 17:18:21 devstack sudo[110480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:21 devstack sudo[110480]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943" returned: 0 in 0.414s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:21 devstack sudo[110493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943
Aug 26 17:18:21 devstack sudo[110493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:21 devstack sudo[110493]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c6a1e703-ad84-4a75-b418-c70efc5d5943" returned: 0 in 0.313s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Lock "cinder-quobyte-c6a1e703-ad84-4a75-b418-c70efc5d5943" released by "delete_volume" :: held 0.804s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:22 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Created reservations ['f9875c1e-ccbd-496a-a4d8-817c2e3c0485', '17f4c9da-671d-405c-b45e-02c0acf01213', '1074f594-e771-401e-be2c-a67ff5474aec', 'bb077cff-53fc-401a-8f5d-c2b066cc39ee'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:22 devstack sudo[110530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:22 devstack sudo[110530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:22 devstack sudo[110530]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.319s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:22 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:22 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Deleted volume successfully.
Aug 26 17:18:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6afde770-c268-4d68-bb75-b92febcf76fc tempest-VolumesExtendTest-234851192 None] Lock "cinder-c6a1e703-ad84-4a75-b418-c70efc5d5943-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:22 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-aaa61946-17e6-478d-87a5-e9370755d0a8 req-d05487e0-1c79-4f65-8f34-e52b5aafe202 tempest-TestInstancesWithCinderVolumes-7102684 None] Terminate volume connection completed successfully.
Aug 26 17:18:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-aaa61946-17e6-478d-87a5-e9370755d0a8 req-d05487e0-1c79-4f65-8f34-e52b5aafe202 tempest-TestInstancesWithCinderVolumes-7102684 None] Deleting attachment ea49fefe-abe2-4ad1-a6c5-af7889a8aaca. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:18:23 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "cinder-4353d6a9-d30f-43a1-b738-1b430eae57f8-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:23 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "cinder-4353d6a9-d30f-43a1-b738-1b430eae57f8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:23 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "cinder-quobyte-4353d6a9-d30f-43a1-b738-1b430eae57f8" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:23 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "cinder-quobyte-4353d6a9-d30f-43a1-b738-1b430eae57f8" acquired by "delete_volume" :: waited 0.031s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:23 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a893d3-6077-43dc-9173-e412aa6dbc23]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4353d6a9-d30f-43a1-b738-1b430eae57f8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:23 devstack sudo[110544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4353d6a9-d30f-43a1-b738-1b430eae57f8
Aug 26 17:18:23 devstack sudo[110544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:23 devstack sudo[110544]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4353d6a9-d30f-43a1-b738-1b430eae57f8" returned: 0 in 0.497s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4353d6a9-d30f-43a1-b738-1b430eae57f8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:23 devstack sudo[110549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4353d6a9-d30f-43a1-b738-1b430eae57f8
Aug 26 17:18:24 devstack sudo[110549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:24 devstack sudo[110549]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4353d6a9-d30f-43a1-b738-1b430eae57f8" returned: 0 in 0.466s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "cinder-quobyte-4353d6a9-d30f-43a1-b738-1b430eae57f8" released by "delete_volume" :: held 1.028s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:24 devstack cinder-volume[94125]: WARNING cinder.quota [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-661368910-2061982230 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-661368910-2061982230, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:18:24 devstack cinder-volume[94125]: WARNING cinder.quota [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-661368910-2061982230 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-661368910-2061982230, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:18:24 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Created reservations ['60d10835-e687-4255-b7a5-009f00908d6e', '9b755953-ca38-4505-b3dc-1805dcc65a49', '09e8feba-f121-4cbb-95e4-a410d21dd613', '2b4f147c-4967-4e08-90a5-8646e4aab2ad'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:24 devstack sudo[110552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:24 devstack sudo[110552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:24 devstack sudo[110552]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.283s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:24 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:24 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Deleted volume successfully.
Aug 26 17:18:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b0d0c98a-a3b9-48e6-9eb8-f0e4e1025c15 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "cinder-4353d6a9-d30f-43a1-b738-1b430eae57f8-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Flow 'volume_create_manager' (49081ad3-f7da-421a-9b51-7b0fe7eae91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439176bf-426a-4236-b088-86ffe5f821a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439176bf-426a-4236-b088-86ffe5f821a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-398784248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedbea1c-322f-4807-b441-bd36245437c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd17df23947f4cc78cda96915add28a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:26Z,use_quota=True,user_id='afe21764fb8746a7bb4bc66fabbc71e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f5526e-b9c2-4ee1-819d-58b5e3e32608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f5526e-b9c2-4ee1-819d-58b5e3e32608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccea14c5-a24f-446b-a7cc-aad5ce0653c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccea14c5-a24f-446b-a7cc-aad5ce0653c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cedbea1c-322f-4807-b441-bd36245437c4', 'volume_name': 'volume-cedbea1c-322f-4807-b441-bd36245437c4', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b60993-a69e-46a5-9a4d-5a54ae3054f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b60993-a69e-46a5-9a4d-5a54ae3054f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df464e32-e4e2-4281-a821-c3550becd749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:26 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Volume cedbea1c-322f-4807-b441-bd36245437c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cedbea1c-322f-4807-b441-bd36245437c4', 'volume_size': 1}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-398784248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedbea1c-322f-4807-b441-bd36245437c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd17df23947f4cc78cda96915add28a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:26Z,use_quota=True,user_id='afe21764fb8746a7bb4bc66fabbc71e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Creating volume cedbea1c-322f-4807-b441-bd36245437c4 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:18:26 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:18:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cedbea1c-322f-4807-b441-bd36245437c4 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:26 devstack sudo[110572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cedbea1c-322f-4807-b441-bd36245437c4 1073741824
Aug 26 17:18:26 devstack sudo[110572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:27 devstack sudo[110572]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cedbea1c-322f-4807-b441-bd36245437c4 1073741824" returned: 0 in 0.528s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cedbea1c-322f-4807-b441-bd36245437c4 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:27 devstack sudo[110582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cedbea1c-322f-4807-b441-bd36245437c4
Aug 26 17:18:27 devstack sudo[110582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Flow 'volume_create_manager' (52e5bda3-d31c-4551-86c1-c5e82466c103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e059fe4a-9570-4087-9516-d164ba182908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e059fe4a-9570-4087-9516-d164ba182908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65124152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798df7c8b05547dbaa09dab2360640ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:27Z,use_quota=True,user_id='bc2f1669421946088e752dd4af8a0521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66ed0b3-5569-4690-ade4-d51a0ee49dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66ed0b3-5569-4690-ade4-d51a0ee49dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23252154-b71c-4868-a351-8f1787d88c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23252154-b71c-4868-a351-8f1787d88c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72', 'volume_name': 'volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033dbb74-bcb7-4451-91b0-5c0eb2e98579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033dbb74-bcb7-4451-91b0-5c0eb2e98579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b596bb-ff8d-4a86-82ee-28a13c9269e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:27 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Volume c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72', 'volume_size': 1}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:27 devstack sudo[110582]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cedbea1c-322f-4807-b441-bd36245437c4" returned: 0 in 0.266s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65124152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798df7c8b05547dbaa09dab2360640ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:27Z,use_quota=True,user_id='bc2f1669421946088e752dd4af8a0521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Creating volume c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:18:27 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df464e32-e4e2-4281-a821-c3550becd749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cedbea1c-322f-4807-b441-bd36245437c4', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:27 devstack sudo[110585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72 1073741824
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1c2f37-f598-4a99-8119-36ed1f0ca489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:27 devstack sudo[110585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:27 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Volume volume-cedbea1c-322f-4807-b441-bd36245437c4 (cedbea1c-322f-4807-b441-bd36245437c4): created successfully
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1c2f37-f598-4a99-8119-36ed1f0ca489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Flow 'volume_create_manager' (49081ad3-f7da-421a-9b51-7b0fe7eae91b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:27 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-58089c87-66b8-4df9-890b-2bbcacb3bc71 tempest-VolumesNegativeTest-665779445 None] Created volume successfully.
Aug 26 17:18:27 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-2c6384ec-8999-4b09-bf69-d464a395e948 req-002daa3f-4adf-464a-a0a0-30a193366826 tempest-TestInstancesWithCinderVolumes-7102684 None] Terminate volume connection completed successfully.
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-2c6384ec-8999-4b09-bf69-d464a395e948 req-002daa3f-4adf-464a-a0a0-30a193366826 tempest-TestInstancesWithCinderVolumes-7102684 None] Deleting attachment 1431f22a-6b4a-41b5-9340-62ecbaaf79cb. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:18:27 devstack sudo[110585]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72 1073741824" returned: 0 in 0.442s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:27 devstack sudo[110596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72
Aug 26 17:18:27 devstack sudo[110596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:28 devstack sudo[110596]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72" returned: 0 in 0.250s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b596bb-ff8d-4a86-82ee-28a13c9269e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fe8664-5944-4cef-9081-b113235974e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:28 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Volume volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72 (c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72): created successfully
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fe8664-5944-4cef-9081-b113235974e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Flow 'volume_create_manager' (52e5bda3-d31c-4551-86c1-c5e82466c103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:28 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-455d7a77-88b7-4e7b-8cb7-b86bc3a95392 tempest-ProjectReaderTests-1130865144 None] Created volume successfully.
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "cinder-1688b1bb-ed43-46de-820c-3af7bae8450a-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "cinder-1688b1bb-ed43-46de-820c-3af7bae8450a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "cinder-quobyte-1688b1bb-ed43-46de-820c-3af7bae8450a" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "cinder-quobyte-1688b1bb-ed43-46de-820c-3af7bae8450a" acquired by "delete_volume" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[1411fa8e-9309-4e23-8762-9feb7de463bf]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1688b1bb-ed43-46de-820c-3af7bae8450a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:28 devstack sudo[110605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1688b1bb-ed43-46de-820c-3af7bae8450a
Aug 26 17:18:28 devstack sudo[110605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:28 devstack sudo[110605]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1688b1bb-ed43-46de-820c-3af7bae8450a" returned: 0 in 0.405s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1688b1bb-ed43-46de-820c-3af7bae8450a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:28 devstack sudo[110610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1688b1bb-ed43-46de-820c-3af7bae8450a
Aug 26 17:18:28 devstack sudo[110610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:29 devstack sudo[110610]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1688b1bb-ed43-46de-820c-3af7bae8450a" returned: 0 in 0.262s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "cinder-quobyte-1688b1bb-ed43-46de-820c-3af7bae8450a" released by "delete_volume" :: held 0.731s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:29 devstack cinder-volume[94125]: WARNING cinder.quota [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-768650160-139840034 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-768650160-139840034, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:18:29 devstack cinder-volume[94125]: WARNING cinder.quota [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-768650160-139840034 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-768650160-139840034, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Created reservations ['110a71df-805c-40a2-8685-a5b859680d7f', 'f2381684-b377-443a-bcc7-f89fc0e86c63', 'e6899b16-f5d5-43bc-9b49-f2563570a702', 'd3b2028f-b292-462e-9432-f90f7c144257'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:29 devstack sudo[110616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:29 devstack sudo[110616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "cinder-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "cinder-quobyte-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-quobyte-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72" acquired by "delete_volume" :: waited 0.034s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[1360ffef-5972-4364-b16a-81791605c1d9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:29 devstack sudo[110616]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.444s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Deleted volume successfully.
Aug 26 17:18:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bc56c08-a504-4934-bfd9-a781ca943e48 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "cinder-1688b1bb-ed43-46de-820c-3af7bae8450a-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:29 devstack sudo[110620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72
Aug 26 17:18:29 devstack sudo[110620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:30 devstack sudo[110620]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72" returned: 0 in 0.558s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:30 devstack sudo[110625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72
Aug 26 17:18:30 devstack sudo[110625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:30 devstack sudo[110625]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72" returned: 0 in 0.332s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-quobyte-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72" released by "delete_volume" :: held 0.974s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:30 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Created reservations ['c7af5de6-08e6-4ac3-a63a-7adf5bd2f8d7', 'ebddc8a0-54f8-4f2f-987f-bf30b1ceab94', 'd1e13945-fc18-4d02-a0f4-43348f7a3477', '2582a61e-6506-4d0e-ba88-dcefcff4832e'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:30 devstack sudo[110628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:30 devstack sudo[110628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:31 devstack sudo[110628]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.427s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:31 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:31 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Deleted volume successfully.
Aug 26 17:18:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8a5e7025-4e0b-497e-a4de-d1e6c5150286 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-c634bfc6-8a7c-4c1c-b88a-66c6a5ce8e72-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Flow 'volume_create_manager' (57084993-5dbc-4eea-86e5-ddb76f0b6f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a82a4c-3626-477d-9496-499afb557861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a82a4c-3626-477d-9496-499afb557861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-348511930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e9e5b7-1ece-4e2e-ba8f-073260187b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798df7c8b05547dbaa09dab2360640ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:33Z,use_quota=True,user_id='bc2f1669421946088e752dd4af8a0521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5f6ad6-7ced-4226-80c0-4b2c4843ab8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5f6ad6-7ced-4226-80c0-4b2c4843ab8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96489ed-a0a4-41f6-b7a5-4e352e171b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96489ed-a0a4-41f6-b7a5-4e352e171b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e9e5b7-1ece-4e2e-ba8f-073260187b0a', 'volume_name': 'volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5662c4-e72e-4f39-b627-252243d65ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5662c4-e72e-4f39-b627-252243d65ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668dc5aa-c536-4561-a8b5-54650d206c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:32 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Volume 36e9e5b7-1ece-4e2e-ba8f-073260187b0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a', 'volume_size': 1}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-348511930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e9e5b7-1ece-4e2e-ba8f-073260187b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798df7c8b05547dbaa09dab2360640ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:33Z,use_quota=True,user_id='bc2f1669421946088e752dd4af8a0521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Creating volume 36e9e5b7-1ece-4e2e-ba8f-073260187b0a {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:18:32 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:18:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:32 devstack sudo[110675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a 1073741824
Aug 26 17:18:32 devstack sudo[110675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:33 devstack sudo[110675]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a 1073741824" returned: 0 in 0.621s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:33 devstack sudo[110681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a
Aug 26 17:18:33 devstack sudo[110681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-2d2d114d-b259-46d3-8b10-bc6668e1e96f req-5c5bf2ed-5750-4633-8fe5-506d679abd95 tempest-TestInstancesWithCinderVolumes-7102684 None] Terminate volume connection completed successfully.
Aug 26 17:18:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-2d2d114d-b259-46d3-8b10-bc6668e1e96f req-5c5bf2ed-5750-4633-8fe5-506d679abd95 tempest-TestInstancesWithCinderVolumes-7102684 None] Deleting attachment 67ba7f5e-fdac-4452-b70e-3d18ba94f9df. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:18:33 devstack sudo[110681]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a" returned: 0 in 0.371s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:18:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668dc5aa-c536-4561-a8b5-54650d206c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5cf3a0-e67f-4a92-816a-334d85b8bdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:33 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Volume volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a (36e9e5b7-1ece-4e2e-ba8f-073260187b0a): created successfully
Aug 26 17:18:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5cf3a0-e67f-4a92-816a-334d85b8bdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Flow 'volume_create_manager' (57084993-5dbc-4eea-86e5-ddb76f0b6f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0e43de99-22d3-4023-bf5b-f121bc604422 tempest-ProjectReaderTests-1130865144 None] Created volume successfully.
Aug 26 17:18:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "cinder-36e9e5b7-1ece-4e2e-ba8f-073260187b0a-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-36e9e5b7-1ece-4e2e-ba8f-073260187b0a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "cinder-quobyte-36e9e5b7-1ece-4e2e-ba8f-073260187b0a" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-quobyte-36e9e5b7-1ece-4e2e-ba8f-073260187b0a" acquired by "delete_volume" :: waited 0.028s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:34 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[99801f7f-d3fe-4c57-9c68-da537983f85b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "cinder-0b21d31e-7c1c-4a82-8f5e-16cf77d95488-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "cinder-0b21d31e-7c1c-4a82-8f5e-16cf77d95488-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "cinder-quobyte-0b21d31e-7c1c-4a82-8f5e-16cf77d95488" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:35 devstack sudo[110687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a
Aug 26 17:18:35 devstack sudo[110687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "cinder-quobyte-0b21d31e-7c1c-4a82-8f5e-16cf77d95488" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:35 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa9a200-226f-46c0-a631-fa3243ffa828]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:35 devstack sudo[110689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488
Aug 26 17:18:35 devstack sudo[110689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:35 devstack sudo[110687]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a" returned: 0 in 0.811s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:35 devstack sudo[110731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a
Aug 26 17:18:35 devstack sudo[110731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:35 devstack sudo[110689]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488" returned: 0 in 0.766s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:35 devstack sudo[110741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488
Aug 26 17:18:35 devstack sudo[110741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:36 devstack sudo[110731]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-36e9e5b7-1ece-4e2e-ba8f-073260187b0a" returned: 0 in 0.369s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-quobyte-36e9e5b7-1ece-4e2e-ba8f-073260187b0a" released by "delete_volume" :: held 1.256s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Created reservations ['8d229d4d-3ff2-4675-87e5-b50a10296ad2', '7b638501-9ad4-4e98-9861-3d2d3ec56580', '6109d0f0-f268-4a49-b808-ac61b5591f7f', '4911b8f9-dcac-41ae-85a6-ac53770cc2a6'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:36 devstack sudo[110741]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-0b21d31e-7c1c-4a82-8f5e-16cf77d95488" returned: 0 in 0.541s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "cinder-quobyte-0b21d31e-7c1c-4a82-8f5e-16cf77d95488" released by "delete_volume" :: held 1.375s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:36 devstack sudo[110761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:36 devstack sudo[110761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:36 devstack cinder-volume[94125]: WARNING cinder.quota [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-566225747-251849606 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-566225747-251849606, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:18:36 devstack cinder-volume[94125]: WARNING cinder.quota [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-566225747-251849606 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-566225747-251849606, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Created reservations ['25fa97d1-5adc-40d2-abbf-a158868e5150', 'd944d0b9-9a41-4125-89b6-181c9cda065f', 'ed14e894-22bd-4d28-8b0f-5d650e099e48', '026f3fef-d6f7-4769-b7a8-beaae4941706'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:36 devstack sudo[110772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:36 devstack sudo[110772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:36 devstack sudo[110761]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.355s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Deleted volume successfully.
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-aeb09500-e2ff-42dd-b43d-9ac0c37f0d67 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-36e9e5b7-1ece-4e2e-ba8f-073260187b0a-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:36 devstack sudo[110772]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.264s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Deleted volume successfully.
Aug 26 17:18:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0dffc068-5b20-414c-a170-c4b412e57ac0 tempest-TestInstancesWithCinderVolumes-7102684 None] Lock "cinder-0b21d31e-7c1c-4a82-8f5e-16cf77d95488-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Flow 'volume_create_manager' (bd696159-bd68-4473-9d02-134b282e7231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22009622-f7ff-4a56-81d8-3c2ba018435b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22009622-f7ff-4a56-81d8-3c2ba018435b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067690653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04563edc-596e-4c4f-82cb-2d7b80878f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798df7c8b05547dbaa09dab2360640ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:37Z,use_quota=True,user_id='bc2f1669421946088e752dd4af8a0521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1abef84-376c-46b4-90db-c8cf911c0ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1abef84-376c-46b4-90db-c8cf911c0ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae58569-c592-4442-b371-45f95503c862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae58569-c592-4442-b371-45f95503c862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04563edc-596e-4c4f-82cb-2d7b80878f39', 'volume_name': 'volume-04563edc-596e-4c4f-82cb-2d7b80878f39', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55dd421-d440-4f28-9793-5a6c9c7c879e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55dd421-d440-4f28-9793-5a6c9c7c879e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3305a874-e244-40ab-82db-61457e795159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:37 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Volume 04563edc-596e-4c4f-82cb-2d7b80878f39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04563edc-596e-4c4f-82cb-2d7b80878f39', 'volume_size': 1}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067690653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04563edc-596e-4c4f-82cb-2d7b80878f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798df7c8b05547dbaa09dab2360640ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:37Z,use_quota=True,user_id='bc2f1669421946088e752dd4af8a0521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Creating volume 04563edc-596e-4c4f-82cb-2d7b80878f39 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:18:37 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:18:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-04563edc-596e-4c4f-82cb-2d7b80878f39 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:37 devstack sudo[110790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-04563edc-596e-4c4f-82cb-2d7b80878f39 1073741824
Aug 26 17:18:37 devstack sudo[110790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:38 devstack sudo[110790]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-04563edc-596e-4c4f-82cb-2d7b80878f39 1073741824" returned: 0 in 0.807s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-04563edc-596e-4c4f-82cb-2d7b80878f39 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:38 devstack sudo[110798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-04563edc-596e-4c4f-82cb-2d7b80878f39
Aug 26 17:18:38 devstack sudo[110798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:38 devstack sudo[110798]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-04563edc-596e-4c4f-82cb-2d7b80878f39" returned: 0 in 0.314s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:18:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3305a874-e244-40ab-82db-61457e795159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04563edc-596e-4c4f-82cb-2d7b80878f39', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73fddac1-74b5-44d1-8ecb-301ce5cb918b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:38 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Volume volume-04563edc-596e-4c4f-82cb-2d7b80878f39 (04563edc-596e-4c4f-82cb-2d7b80878f39): created successfully
Aug 26 17:18:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73fddac1-74b5-44d1-8ecb-301ce5cb918b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Flow 'volume_create_manager' (bd696159-bd68-4473-9d02-134b282e7231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5e65c18f-a61d-42a9-bd5a-eceac4faa03e tempest-ProjectReaderTests-1130865144 None] Created volume successfully.
Aug 26 17:18:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "cinder-04563edc-596e-4c4f-82cb-2d7b80878f39-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-04563edc-596e-4c4f-82cb-2d7b80878f39-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "cinder-quobyte-04563edc-596e-4c4f-82cb-2d7b80878f39" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-quobyte-04563edc-596e-4c4f-82cb-2d7b80878f39" acquired by "delete_volume" :: waited 0.039s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:40 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76a6fb-3719-43fe-a77d-799b44a76d1e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-04563edc-596e-4c4f-82cb-2d7b80878f39 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:40 devstack sudo[110807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-04563edc-596e-4c4f-82cb-2d7b80878f39
Aug 26 17:18:40 devstack sudo[110807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:40 devstack sudo[110807]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-04563edc-596e-4c4f-82cb-2d7b80878f39" returned: 0 in 0.585s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-04563edc-596e-4c4f-82cb-2d7b80878f39 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:40 devstack sudo[110832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-04563edc-596e-4c4f-82cb-2d7b80878f39
Aug 26 17:18:40 devstack sudo[110832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:40 devstack sudo[110832]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-04563edc-596e-4c4f-82cb-2d7b80878f39" returned: 0 in 0.303s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-quobyte-04563edc-596e-4c4f-82cb-2d7b80878f39" released by "delete_volume" :: held 0.956s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:41 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Created reservations ['70bc8193-dc38-4540-85d7-cfcc321af9c0', '675098ee-cdd8-432e-9c77-0427e52160f6', '3d2ea9e3-b8bd-4224-9ca7-0c5fd47e7b50', 'ad3c5ea6-edb9-499a-97e3-9ca8682667ea'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:41 devstack sudo[110835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:41 devstack sudo[110835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:41 devstack sudo[110835]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.342s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:41 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:41 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Deleted volume successfully.
Aug 26 17:18:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e2b74dc3-52ac-4487-a633-8404bdd5a748 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-04563edc-596e-4c4f-82cb-2d7b80878f39-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:42 devstack sudo[110840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:42 devstack sudo[110840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:42 devstack sudo[110840]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.303s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 29 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>, <Thread(Rabbit-heartbeat, started daemon 133049442341056)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Flow 'volume_create_manager' (24b1567c-3d91-4aed-89fa-f3c7ea2521db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97689c0-5ee3-41c8-b5ab-ca1e0b28cac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97689c0-5ee3-41c8-b5ab-ca1e0b28cac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1621857971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada12d92-5679-4cbb-a132-dd35c5ffd754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798df7c8b05547dbaa09dab2360640ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:43Z,use_quota=True,user_id='bc2f1669421946088e752dd4af8a0521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545265ef-c42a-4f61-ac91-a506baacbb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545265ef-c42a-4f61-ac91-a506baacbb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe298e4-f665-462f-bb87-4316c787fa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe298e4-f665-462f-bb87-4316c787fa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada12d92-5679-4cbb-a132-dd35c5ffd754', 'volume_name': 'volume-ada12d92-5679-4cbb-a132-dd35c5ffd754', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1134889f-dca7-43bb-a6d5-b68aae5ab94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1134889f-dca7-43bb-a6d5-b68aae5ab94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df677bf-7fb1-443d-9ceb-4985b9e48f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:42 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Volume ada12d92-5679-4cbb-a132-dd35c5ffd754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada12d92-5679-4cbb-a132-dd35c5ffd754', 'volume_size': 1}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1621857971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada12d92-5679-4cbb-a132-dd35c5ffd754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798df7c8b05547dbaa09dab2360640ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:43Z,use_quota=True,user_id='bc2f1669421946088e752dd4af8a0521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Creating volume ada12d92-5679-4cbb-a132-dd35c5ffd754 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:18:42 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:18:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ada12d92-5679-4cbb-a132-dd35c5ffd754 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:42 devstack sudo[110843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ada12d92-5679-4cbb-a132-dd35c5ffd754 1073741824
Aug 26 17:18:42 devstack sudo[110843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:43 devstack sudo[110843]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ada12d92-5679-4cbb-a132-dd35c5ffd754 1073741824" returned: 0 in 0.510s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ada12d92-5679-4cbb-a132-dd35c5ffd754 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:43 devstack sudo[110850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ada12d92-5679-4cbb-a132-dd35c5ffd754
Aug 26 17:18:43 devstack sudo[110850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:43 devstack sudo[110850]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ada12d92-5679-4cbb-a132-dd35c5ffd754" returned: 0 in 0.316s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:18:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df677bf-7fb1-443d-9ceb-4985b9e48f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada12d92-5679-4cbb-a132-dd35c5ffd754', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb23d55-809c-49b3-aadb-d8bc6ffe2753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:43 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Volume volume-ada12d92-5679-4cbb-a132-dd35c5ffd754 (ada12d92-5679-4cbb-a132-dd35c5ffd754): created successfully
Aug 26 17:18:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb23d55-809c-49b3-aadb-d8bc6ffe2753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Flow 'volume_create_manager' (24b1567c-3d91-4aed-89fa-f3c7ea2521db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:43 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5a829554-e596-450c-a9e2-9357ecfad9a2 tempest-ProjectReaderTests-1130865144 None] Created volume successfully.
Aug 26 17:18:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "cinder-ada12d92-5679-4cbb-a132-dd35c5ffd754-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-ada12d92-5679-4cbb-a132-dd35c5ffd754-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "cinder-quobyte-ada12d92-5679-4cbb-a132-dd35c5ffd754" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-quobyte-ada12d92-5679-4cbb-a132-dd35c5ffd754" acquired by "delete_volume" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:44 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb8f595-0ce9-4a67-a2fb-9abd1e843c71]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ada12d92-5679-4cbb-a132-dd35c5ffd754 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:45 devstack sudo[110855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ada12d92-5679-4cbb-a132-dd35c5ffd754
Aug 26 17:18:45 devstack sudo[110855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:45 devstack sudo[110855]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ada12d92-5679-4cbb-a132-dd35c5ffd754" returned: 0 in 0.421s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ada12d92-5679-4cbb-a132-dd35c5ffd754 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:45 devstack sudo[110860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ada12d92-5679-4cbb-a132-dd35c5ffd754
Aug 26 17:18:45 devstack sudo[110860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:45 devstack sudo[110860]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ada12d92-5679-4cbb-a132-dd35c5ffd754" returned: 0 in 0.283s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-quobyte-ada12d92-5679-4cbb-a132-dd35c5ffd754" released by "delete_volume" :: held 0.764s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:45 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Created reservations ['44f2f764-cae1-4850-aebb-b09aaed46f5a', '116936e7-5d5b-49f8-8d2b-54432c5337d3', '172dc817-b1ea-4e03-8acc-55e69a27b30d', 'ad7898be-c92e-4678-b1ad-ca0067d6b6a9'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:45 devstack sudo[110864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:45 devstack sudo[110864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:46 devstack sudo[110864]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.335s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:46 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Deleted volume successfully.
Aug 26 17:18:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0569fd0f-2f54-4f56-8230-8be0f97868c6 tempest-ProjectReaderTests-1130865144 None] Lock "cinder-ada12d92-5679-4cbb-a132-dd35c5ffd754-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Acquiring lock "cinder-cedbea1c-322f-4807-b441-bd36245437c4-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Lock "cinder-cedbea1c-322f-4807-b441-bd36245437c4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Acquiring lock "cinder-quobyte-cedbea1c-322f-4807-b441-bd36245437c4" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:18:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Lock "cinder-quobyte-cedbea1c-322f-4807-b441-bd36245437c4" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c7a32e-9073-4d0d-a202-8041cbc63779]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cedbea1c-322f-4807-b441-bd36245437c4 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:50 devstack sudo[110869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cedbea1c-322f-4807-b441-bd36245437c4
Aug 26 17:18:50 devstack sudo[110869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:50 devstack sudo[110869]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cedbea1c-322f-4807-b441-bd36245437c4" returned: 0 in 0.365s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cedbea1c-322f-4807-b441-bd36245437c4 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:50 devstack sudo[110875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cedbea1c-322f-4807-b441-bd36245437c4
Aug 26 17:18:50 devstack sudo[110875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:50 devstack sudo[110875]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cedbea1c-322f-4807-b441-bd36245437c4" returned: 0 in 0.294s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Lock "cinder-quobyte-cedbea1c-322f-4807-b441-bd36245437c4" released by "delete_volume" :: held 0.703s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Created reservations ['adc45b0f-1696-4c97-b009-136ba3549e3f', 'de5000c9-bc6d-4d81-9587-0436273bc96d', '37ea3c88-d4c3-42fa-af03-a34bf1d9af0c', 'b51fd326-05ea-4d88-b7f3-5e5acc18b729'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:50 devstack sudo[110878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:18:50 devstack sudo[110878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:51 devstack sudo[110878]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.254s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:51 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:18:51 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Deleted volume successfully.
Aug 26 17:18:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-910f3efc-8300-47bb-83e0-0248d746ac58 tempest-VolumesNegativeTest-665779445 None] Lock "cinder-cedbea1c-322f-4807-b441-bd36245437c4-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Flow 'volume_create_manager' (1f2b26c4-6ff9-4e54-a74f-be5cb5f14b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4afe7440-79fb-4b78-8078-1bf5338406c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4afe7440-79fb-4b78-8078-1bf5338406c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-711316422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328d3b54-5f82-490e-99e6-bc0012200aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497f47d6a3884d57868a81975e7d3ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:54Z,use_quota=True,user_id='bfd0aa91594548eca900af6935409d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44ee691-cf4b-40a3-904b-ef28f6a0d4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44ee691-cf4b-40a3-904b-ef28f6a0d4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1b0f0e-4046-4189-aadc-88389be73b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1b0f0e-4046-4189-aadc-88389be73b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '328d3b54-5f82-490e-99e6-bc0012200aab', 'volume_name': 'volume-328d3b54-5f82-490e-99e6-bc0012200aab', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b401df06-9fab-4fe2-82d2-2c2207f62239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b401df06-9fab-4fe2-82d2-2c2207f62239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70b96b0-2087-415b-b8b1-100ecc0e3491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:53 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Volume 328d3b54-5f82-490e-99e6-bc0012200aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-328d3b54-5f82-490e-99e6-bc0012200aab', 'volume_size': 1}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-711316422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328d3b54-5f82-490e-99e6-bc0012200aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497f47d6a3884d57868a81975e7d3ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:18:54Z,use_quota=True,user_id='bfd0aa91594548eca900af6935409d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Creating volume 328d3b54-5f82-490e-99e6-bc0012200aab {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:18:53 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:18:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:53 devstack sudo[110883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab 1073741824
Aug 26 17:18:53 devstack sudo[110883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:54 devstack sudo[110883]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab 1073741824" returned: 0 in 0.459s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:54 devstack sudo[110889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab
Aug 26 17:18:54 devstack sudo[110889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:54 devstack sudo[110889]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab" returned: 0 in 0.251s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:18:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70b96b0-2087-415b-b8b1-100ecc0e3491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-328d3b54-5f82-490e-99e6-bc0012200aab', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe90a0e-8ff7-4550-a3f2-88820802a338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:18:54 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Volume volume-328d3b54-5f82-490e-99e6-bc0012200aab (328d3b54-5f82-490e-99e6-bc0012200aab): created successfully
Aug 26 17:18:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe90a0e-8ff7-4550-a3f2-88820802a338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:18:54 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Flow 'volume_create_manager' (1f2b26c4-6ff9-4e54-a74f-be5cb5f14b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:18:54 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6df6e337-0563-4727-bee7-e1c0dfd33c01 tempest-VolumesSnapshotListTestJSON-662025889 None] Created volume successfully.
Aug 26 17:18:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] Creating offline snapshot f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 of volume 328d3b54-5f82-490e-99e6-bc0012200aab {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:18:55 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f69fbb-aa20-44dd-bdfb-859c47812146]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:55 devstack sudo[110892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab
Aug 26 17:18:55 devstack sudo[110892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:55 devstack sudo[110892]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab" returned: 0 in 0.373s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:55 devstack sudo[110897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 1G
Aug 26 17:18:55 devstack sudo[110897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:55 devstack sudo[110897]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 1G" returned: 0 in 0.413s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-328d3b54-5f82-490e-99e6-bc0012200aab -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:55 devstack sudo[110903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-328d3b54-5f82-490e-99e6-bc0012200aab -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78
Aug 26 17:18:55 devstack sudo[110903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:56 devstack sudo[110903]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-328d3b54-5f82-490e-99e6-bc0012200aab -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78" returned: 0 in 0.297s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:56 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 is being set with open permissions: ugo+rw
Aug 26 17:18:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:56 devstack sudo[110908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78
Aug 26 17:18:56 devstack sudo[110908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:56 devstack sudo[110908]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78" returned: 0 in 0.244s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:56 devstack sudo[110912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.info
Aug 26 17:18:56 devstack sudo[110912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:56 devstack sudo[110912]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.info" returned: 0 in 0.294s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:56 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.info is being set with open permissions: ugo+rw
Aug 26 17:18:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:56 devstack sudo[110915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.info
Aug 26 17:18:56 devstack sudo[110915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:56 devstack sudo[110915]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.info" returned: 0 in 0.256s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:57 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0092fb34-7e48-420f-8b50-fa4bc2830e50 tempest-VolumesSnapshotListTestJSON-662025889 None] Create snapshot completed successfully
Aug 26 17:18:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] Creating offline snapshot f8fbc6bd-959f-4103-9058-9bc1d957f7b6 of volume 328d3b54-5f82-490e-99e6-bc0012200aab {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:18:57 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aed0119-346c-41e5-9990-3000b0fbf4b8]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:57 devstack sudo[110918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78
Aug 26 17:18:57 devstack sudo[110918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:57 devstack sudo[110918]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78" returned: 0 in 0.413s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-328d3b54-5f82-490e-99e6-bc0012200aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:18:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:57 devstack sudo[110924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 1G
Aug 26 17:18:57 devstack sudo[110924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:58 devstack sudo[110924]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 1G" returned: 0 in 0.549s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:58 devstack sudo[110930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6
Aug 26 17:18:58 devstack sudo[110930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:58 devstack sudo[110930]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6" returned: 0 in 0.329s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:58 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 is being set with open permissions: ugo+rw
Aug 26 17:18:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:58 devstack sudo[110939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6
Aug 26 17:18:58 devstack sudo[110939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:18:58 devstack sudo[110939]: pam_unix(sudo:session): session closed for user root
Aug 26 17:18:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6" returned: 0 in 0.286s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:18:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.709s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:18:59 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b4eb4b48-b6af-4361-b672-3adeefd31ac8 tempest-VolumesSnapshotListTestJSON-662025889 None] Create snapshot completed successfully
Aug 26 17:18:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:18:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:18:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] Creating offline snapshot da55f582-f94a-43fa-966a-ac9a20d34c6e of volume 328d3b54-5f82-490e-99e6-bc0012200aab {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:18:59 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93a3821-b034-47b4-8fc2-7e0c3f60a819]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:18:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:18:59 devstack sudo[110942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6
Aug 26 17:18:59 devstack sudo[110942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:00 devstack sudo[110942]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6" returned: 0 in 0.491s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-328d3b54-5f82-490e-99e6-bc0012200aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:19:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:00 devstack sudo[110947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e 1G
Aug 26 17:19:00 devstack sudo[110947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:00 devstack sudo[110947]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e 1G" returned: 0 in 0.520s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:00 devstack sudo[110953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e
Aug 26 17:19:00 devstack sudo[110953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:01 devstack sudo[110953]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e" returned: 0 in 0.304s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:01 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e is being set with open permissions: ugo+rw
Aug 26 17:19:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:01 devstack sudo[110958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e
Aug 26 17:19:01 devstack sudo[110958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:01 devstack sudo[110958]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e" returned: 0 in 0.260s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.698s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:19:01 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0bb273a2-2697-43f1-97c2-fd203559a91e tempest-VolumesSnapshotListTestJSON-662025889 None] Create snapshot completed successfully
Aug 26 17:19:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "cinder-da55f582-f94a-43fa-966a-ac9a20d34c6e-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-da55f582-f94a-43fa-966a-ac9a20d34c6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "cinder-quobyte-328d3b54-5f82-490e-99e6-bc0012200aab" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-328d3b54-5f82-490e-99e6-bc0012200aab" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "cinder-quobyte-da55f582-f94a-43fa-966a-ac9a20d34c6e" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-da55f582-f94a-43fa-966a-ac9a20d34c6e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Deleting offline snapshot da55f582-f94a-43fa-966a-ac9a20d34c6e of volume 328d3b54-5f82-490e-99e6-bc0012200aab {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:19:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] snapshot_file for this snap is: volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:19:02 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[977a43e1-1375-437f-a43b-661bb351d2bf]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:19:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:02 devstack sudo[110961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e
Aug 26 17:19:02 devstack sudo[110961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:03 devstack sudo[110961]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e" returned: 0 in 0.383s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-328d3b54-5f82-490e-99e6-bc0012200aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:19:03 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cecaffc-b9fd-45d5-9772-de28d02b0066]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:19:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:03 devstack sudo[110966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6
Aug 26 17:19:03 devstack sudo[110966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:03 devstack sudo[110966]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6" returned: 0 in 0.369s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-328d3b54-5f82-490e-99e6-bc0012200aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:19:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:03 devstack sudo[110971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e
Aug 26 17:19:03 devstack sudo[110971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:03 devstack sudo[110971]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e" returned: 0 in 0.415s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:03 devstack sudo[110977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e
Aug 26 17:19:03 devstack sudo[110977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:04 devstack sudo[110977]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.da55f582-f94a-43fa-966a-ac9a20d34c6e" returned: 0 in 0.240s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-da55f582-f94a-43fa-966a-ac9a20d34c6e" released by "_delete_snapshot" :: held 1.506s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-328d3b54-5f82-490e-99e6-bc0012200aab" released by "delete_snapshot" :: held 1.528s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:INSERT=40,cinder:SELECT=142,cinder:UPDATE=151,cinder:DELETE=11 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=154,cinder:SELECT=122,cinder:INSERT=42,cinder:DELETE=16 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Created reservations ['9587b1fc-9bcb-43c0-a58f-8a6e6328957b', 'f9766bf4-02c6-4119-b52c-6de545765893', 'c3688550-a554-4e33-ac7a-e1743aaee032', 'a8015169-f904-4334-8dda-ff7dcf80f2fb'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:19:04 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Delete snapshot completed successfully.
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4922c4ea-a4b8-4cab-82fd-cc58730f4daf tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-da55f582-f94a-43fa-966a-ac9a20d34c6e-delete_snapshot" released by "delete_snapshot" :: held 1.715s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "cinder-f8fbc6bd-959f-4103-9058-9bc1d957f7b6-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-f8fbc6bd-959f-4103-9058-9bc1d957f7b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "cinder-quobyte-328d3b54-5f82-490e-99e6-bc0012200aab" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-328d3b54-5f82-490e-99e6-bc0012200aab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "cinder-quobyte-f8fbc6bd-959f-4103-9058-9bc1d957f7b6" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-f8fbc6bd-959f-4103-9058-9bc1d957f7b6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Deleting offline snapshot f8fbc6bd-959f-4103-9058-9bc1d957f7b6 of volume 328d3b54-5f82-490e-99e6-bc0012200aab {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] snapshot_file for this snap is: volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[145c301e-4564-4243-9622-0aa261d284bf]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:19:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:04 devstack sudo[110981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6
Aug 26 17:19:04 devstack sudo[110981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:05 devstack sudo[110981]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6" returned: 0 in 0.363s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-328d3b54-5f82-490e-99e6-bc0012200aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:19:05 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f31503-751c-4a01-a135-400154bbe87c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:19:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:05 devstack sudo[110987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78
Aug 26 17:19:05 devstack sudo[110987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:05 devstack sudo[110987]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78" returned: 0 in 0.496s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-328d3b54-5f82-490e-99e6-bc0012200aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:19:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:05 devstack sudo[110992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6
Aug 26 17:19:05 devstack sudo[110992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:06 devstack sudo[110992]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6" returned: 0 in 0.391s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:06 devstack sudo[110998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6
Aug 26 17:19:06 devstack sudo[110998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:06 devstack sudo[110998]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f8fbc6bd-959f-4103-9058-9bc1d957f7b6" returned: 0 in 0.251s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-f8fbc6bd-959f-4103-9058-9bc1d957f7b6" released by "_delete_snapshot" :: held 1.601s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-328d3b54-5f82-490e-99e6-bc0012200aab" released by "delete_snapshot" :: held 1.624s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Created reservations ['ec1bc8e7-f213-4c48-90b1-1faea0620851', '0ef1e946-93b6-46d4-9f6b-b562c6120f64', '2331a143-f490-42ea-8835-155a864ecf20', '9eb85c13-f731-4728-9463-f2059efa97fa'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:19:06 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Delete snapshot completed successfully.
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-dd008ea6-8f36-4ee4-ad44-c898af0296a3 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-f8fbc6bd-959f-4103-9058-9bc1d957f7b6-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "cinder-f0bdb8d1-8e4e-43e8-b32e-afc07b205a78-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-f0bdb8d1-8e4e-43e8-b32e-afc07b205a78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "cinder-quobyte-328d3b54-5f82-490e-99e6-bc0012200aab" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-328d3b54-5f82-490e-99e6-bc0012200aab" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "cinder-quobyte-f0bdb8d1-8e4e-43e8-b32e-afc07b205a78" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-f0bdb8d1-8e4e-43e8-b32e-afc07b205a78" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Deleting offline snapshot f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 of volume 328d3b54-5f82-490e-99e6-bc0012200aab {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] snapshot_file for this snap is: volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4f2f16-ca9c-4387-b792-138e6a24a8d9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:19:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:07 devstack sudo[111002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78
Aug 26 17:19:07 devstack sudo[111002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:07 devstack sudo[111002]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78" returned: 0 in 0.399s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-328d3b54-5f82-490e-99e6-bc0012200aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:19:07 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[286a9f74-97fd-431a-bbb6-c4fc3f77f365]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:19:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:07 devstack sudo[111008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab
Aug 26 17:19:07 devstack sudo[111008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:07 devstack sudo[111008]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab" returned: 0 in 0.383s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:07 devstack sudo[111013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78
Aug 26 17:19:07 devstack sudo[111013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:08 devstack sudo[111013]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78" returned: 0 in 0.374s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:08 devstack sudo[111019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78
Aug 26 17:19:08 devstack sudo[111019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:08 devstack sudo[111019]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab.f0bdb8d1-8e4e-43e8-b32e-afc07b205a78" returned: 0 in 0.239s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-f0bdb8d1-8e4e-43e8-b32e-afc07b205a78" released by "_delete_snapshot" :: held 1.514s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-328d3b54-5f82-490e-99e6-bc0012200aab" released by "delete_snapshot" :: held 1.541s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:08 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Created reservations ['ae2750cc-1fac-4183-b5ba-c020fe48e520', '0c6bcae9-7e53-4244-9bdb-33531c246f12', '51f841ec-6939-4495-8ffa-91aa0152e421', 'e442c9b3-f6bd-471d-aa6e-927b639972fa'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:19:08 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Delete snapshot completed successfully.
Aug 26 17:19:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-161997db-08a9-432d-90f8-d4c717684259 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-f0bdb8d1-8e4e-43e8-b32e-afc07b205a78-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "cinder-328d3b54-5f82-490e-99e6-bc0012200aab-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-328d3b54-5f82-490e-99e6-bc0012200aab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "cinder-quobyte-328d3b54-5f82-490e-99e6-bc0012200aab" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-328d3b54-5f82-490e-99e6-bc0012200aab" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:09 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2573f18d-11ea-4fcc-ab29-a5511b07b18c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:19:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:09 devstack sudo[111022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab
Aug 26 17:19:09 devstack sudo[111022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:09 devstack sudo[111022]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab" returned: 0 in 0.394s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:09 devstack sudo[111027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab
Aug 26 17:19:09 devstack sudo[111027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:09 devstack sudo[111027]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-328d3b54-5f82-490e-99e6-bc0012200aab" returned: 0 in 0.274s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-quobyte-328d3b54-5f82-490e-99e6-bc0012200aab" released by "delete_volume" :: held 0.737s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:09 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Created reservations ['be281136-e195-47f6-93a5-009f96d07f9a', 'e700ab51-2f69-47a1-9292-83139ae5a4b0', 'e198732f-bd4c-464e-a1ff-e208a95e6fa4', '96e8bc36-7242-4989-b5da-3a2ec074bf79'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:19:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:19:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:19:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:19:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:19:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:19:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:10 devstack sudo[111030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:19:10 devstack sudo[111030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:10 devstack sudo[111030]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.264s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:10 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:19:10 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Deleted volume successfully.
Aug 26 17:19:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c324598f-de2e-4d1b-96dc-42b85f8efd40 tempest-VolumesSnapshotListTestJSON-662025889 None] Lock "cinder-328d3b54-5f82-490e-99e6-bc0012200aab-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Flow 'volume_create_manager' (1538190b-fbab-442f-9d72-98da520a75c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76605c67-724f-407a-897f-d144c6c4a524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76605c67-724f-407a-897f-d144c6c4a524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1744783889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff3d47b-64af-4293-abf2-127f1d60bbaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b60e5ffec2546d1a2ee9ebde23c6f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:19:12Z,use_quota=True,user_id='0a407153c8e549c5a7c4c62df87f201c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de271bbe-75e4-48f6-a28e-569e4a3c54aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de271bbe-75e4-48f6-a28e-569e4a3c54aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e604cbc-677b-4f54-8920-806235ebef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e604cbc-677b-4f54-8920-806235ebef93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff3d47b-64af-4293-abf2-127f1d60bbaa', 'volume_name': 'volume-dff3d47b-64af-4293-abf2-127f1d60bbaa', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5403a08d-884e-48ed-a514-9cb02dc71c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5403a08d-884e-48ed-a514-9cb02dc71c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1bf5b41-144f-4032-a610-42c3d497e074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:19:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Volume dff3d47b-64af-4293-abf2-127f1d60bbaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff3d47b-64af-4293-abf2-127f1d60bbaa', 'volume_size': 1}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1744783889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff3d47b-64af-4293-abf2-127f1d60bbaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b60e5ffec2546d1a2ee9ebde23c6f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:19:12Z,use_quota=True,user_id='0a407153c8e549c5a7c4c62df87f201c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Creating volume dff3d47b-64af-4293-abf2-127f1d60bbaa {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:19:12 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:12 devstack sudo[111033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa 1073741824
Aug 26 17:19:12 devstack sudo[111033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:12 devstack sudo[111033]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa 1073741824" returned: 0 in 0.433s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:12 devstack sudo[111039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa
Aug 26 17:19:12 devstack sudo[111039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:12 devstack sudo[111039]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa" returned: 0 in 0.252s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:19:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1bf5b41-144f-4032-a610-42c3d497e074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff3d47b-64af-4293-abf2-127f1d60bbaa', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:19:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9001a866-702f-4e7a-8ff4-a7d1d14c0876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:19:13 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Volume volume-dff3d47b-64af-4293-abf2-127f1d60bbaa (dff3d47b-64af-4293-abf2-127f1d60bbaa): created successfully
Aug 26 17:19:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9001a866-702f-4e7a-8ff4-a7d1d14c0876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:19:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Flow 'volume_create_manager' (1538190b-fbab-442f-9d72-98da520a75c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:19:13 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c834cb4a-3ab1-433f-a5f1-2fc2943e531c tempest-TestImageHashVerification-1912840346 None] Created volume successfully.
Aug 26 17:19:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:19:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:19:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37c7a7c-4884-4b32-afc4-c8682d65c525]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:19:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:14 devstack sudo[111042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa
Aug 26 17:19:14 devstack sudo[111042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:14 devstack sudo[111042]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa" returned: 0 in 0.362s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a5f703-24af-4095-8a9d-6ecd87cf8321]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:19:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:14 devstack sudo[111047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa
Aug 26 17:19:14 devstack sudo[111047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:14 devstack sudo[111047]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa" returned: 0 in 0.357s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa /opt/stack/data/cinder/conversion/dff3d47b-64af-4293-abf2-127f1d60bbaa.temp_image.19f0ab4d-5c67-4ada-912f-7539fe74f6a5vg4w2ujo.img {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:14 devstack sudo[111052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa /opt/stack/data/cinder/conversion/dff3d47b-64af-4293-abf2-127f1d60bbaa.temp_image.19f0ab4d-5c67-4ada-912f-7539fe74f6a5vg4w2ujo.img
Aug 26 17:19:14 devstack sudo[111052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:19 devstack sudo[111052]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa /opt/stack/data/cinder/conversion/dff3d47b-64af-4293-abf2-127f1d60bbaa.temp_image.19f0ab4d-5c67-4ada-912f-7539fe74f6a5vg4w2ujo.img" returned: 0 in 4.491s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:19 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc61df3-efb5-49be-b6bd-e5569b3715a1]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:19:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:19 devstack sudo[111066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa
Aug 26 17:19:19 devstack sudo[111066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:19 devstack sudo[111066]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa" returned: 0 in 0.634s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:19 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa, size 1024.00 MB, duration 4.49 sec, destination /opt/stack/data/cinder/conversion/dff3d47b-64af-4293-abf2-127f1d60bbaa.temp_image.19f0ab4d-5c67-4ada-912f-7539fe74f6a5vg4w2ujo.img {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:19:19 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] Converted 1024.00 MB image at 227.97 MB/s
Aug 26 17:19:19 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] 19f0ab4d-5c67-4ada-912f-7539fe74f6a5 was raw, no need to convert to raw {{(pid=94125) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Aug 26 17:19:29 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:INSERT=8,cinder:UPDATE=23,cinder:SELECT=20,cinder:DELETE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:19:29 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=24,cinder:INSERT=9,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.116s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] Uploaded volume to glance image-id: 19f0ab4d-5c67-4ada-912f-7539fe74f6a5. {{(pid=94125) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:42 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e0ba5fac-f4b7-444d-a6f1-6d5de7ec06d8 tempest-TestImageHashVerification-1912840346 None] Copy volume to image completed successfully.
Aug 26 17:19:42 devstack sudo[111139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:19:42 devstack sudo[111139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:42 devstack sudo[111139]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.280s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 29 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:19:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>, <Thread(Rabbit-heartbeat, started daemon 133049442341056)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:19:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Acquiring lock "cinder-dff3d47b-64af-4293-abf2-127f1d60bbaa-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Lock "cinder-dff3d47b-64af-4293-abf2-127f1d60bbaa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Acquiring lock "cinder-quobyte-dff3d47b-64af-4293-abf2-127f1d60bbaa" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:19:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Lock "cinder-quobyte-dff3d47b-64af-4293-abf2-127f1d60bbaa" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:19:44 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b02c22-9407-443c-ae0c-9a2f87b88ea5]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:19:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:44 devstack sudo[111208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa
Aug 26 17:19:44 devstack sudo[111208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:44 devstack sudo[111208]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa" returned: 0 in 0.441s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:44 devstack sudo[111232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa
Aug 26 17:19:44 devstack sudo[111232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:45 devstack sudo[111232]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-dff3d47b-64af-4293-abf2-127f1d60bbaa" returned: 0 in 0.255s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Lock "cinder-quobyte-dff3d47b-64af-4293-abf2-127f1d60bbaa" released by "delete_volume" :: held 0.774s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:45 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Created reservations ['c6100dc5-b655-470d-a0c7-536851891a67', 'd7d320fc-355d-4d2c-b97f-30d88be4f92a', '7717517d-0b9c-40fa-a908-bd034177174d', '74f7f398-54f5-438d-ac0d-82de14991d07'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:19:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:19:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:19:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:19:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:19:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:19:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:45 devstack sudo[111245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:19:45 devstack sudo[111245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:45 devstack sudo[111245]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.267s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:45 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:19:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Deleted volume successfully.
Aug 26 17:19:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ccf1c554-e667-4541-9efc-81a334708488 tempest-TestImageHashVerification-1912840346 None] Lock "cinder-dff3d47b-64af-4293-abf2-127f1d60bbaa-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Flow 'volume_create_manager' (8ce64d42-d75f-4316-8f4a-78ddefb0a3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273e75c4-0004-4f43-b44d-db791f94a64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273e75c4-0004-4f43-b44d-db791f94a64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-411031021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7816cfff-4cda-4660-8210-080d17515c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f485f8516c64d7b9bbcb59895af0f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:19:48Z,use_quota=True,user_id='90edb7d17a4144bda99865ee0614bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0999cf6-06fc-4d1e-8d81-ea0f8226d56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0999cf6-06fc-4d1e-8d81-ea0f8226d56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be46fa5f-6735-404e-8835-bad43c2207bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be46fa5f-6735-404e-8835-bad43c2207bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7816cfff-4cda-4660-8210-080d17515c3b', 'volume_name': 'volume-7816cfff-4cda-4660-8210-080d17515c3b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae4d411-cd38-4ced-9392-a5acebdc360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae4d411-cd38-4ced-9392-a5acebdc360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077c113f-9df2-420c-8efa-d3f2097389d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:19:48 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Volume 7816cfff-4cda-4660-8210-080d17515c3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7816cfff-4cda-4660-8210-080d17515c3b', 'volume_size': 1}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-411031021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7816cfff-4cda-4660-8210-080d17515c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f485f8516c64d7b9bbcb59895af0f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:19:48Z,use_quota=True,user_id='90edb7d17a4144bda99865ee0614bc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Creating volume 7816cfff-4cda-4660-8210-080d17515c3b {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:19:48 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:19:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7816cfff-4cda-4660-8210-080d17515c3b 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:48 devstack sudo[111253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7816cfff-4cda-4660-8210-080d17515c3b 1073741824
Aug 26 17:19:48 devstack sudo[111253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:49 devstack sudo[111253]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7816cfff-4cda-4660-8210-080d17515c3b 1073741824" returned: 0 in 0.478s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7816cfff-4cda-4660-8210-080d17515c3b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:19:49 devstack sudo[111258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7816cfff-4cda-4660-8210-080d17515c3b
Aug 26 17:19:49 devstack sudo[111258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:19:49 devstack sudo[111258]: pam_unix(sudo:session): session closed for user root
Aug 26 17:19:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7816cfff-4cda-4660-8210-080d17515c3b" returned: 0 in 0.338s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:19:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:19:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:19:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077c113f-9df2-420c-8efa-d3f2097389d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7816cfff-4cda-4660-8210-080d17515c3b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:19:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be5eea89-64ac-426a-b1f9-9b4c615961c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:19:49 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Volume volume-7816cfff-4cda-4660-8210-080d17515c3b (7816cfff-4cda-4660-8210-080d17515c3b): created successfully
Aug 26 17:19:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be5eea89-64ac-426a-b1f9-9b4c615961c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:19:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Flow 'volume_create_manager' (8ce64d42-d75f-4316-8f4a-78ddefb0a3fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:19:49 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b25ecf77-e3e0-4acc-a184-7f46c8ffe630 tempest-TestMinimumBasicScenario-152630880 None] Created volume successfully.
Aug 26 17:19:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-e71e4bba-ce62-4c91-9dea-29459d991eb4 req-ea22ca84-017d-471b-86c1-0a2ebdcb319b tempest-TestMinimumBasicScenario-152630880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:19:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-e71e4bba-ce62-4c91-9dea-29459d991eb4 req-ea22ca84-017d-471b-86c1-0a2ebdcb319b tempest-TestMinimumBasicScenario-152630880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:19:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-e71e4bba-ce62-4c91-9dea-29459d991eb4 req-ea22ca84-017d-471b-86c1-0a2ebdcb319b tempest-TestMinimumBasicScenario-152630880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:19:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-e71e4bba-ce62-4c91-9dea-29459d991eb4 req-ea22ca84-017d-471b-86c1-0a2ebdcb319b tempest-TestMinimumBasicScenario-152630880 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-7816cfff-4cda-4660-8210-080d17515c3b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae7bfd88-9183-4f4a-8ef2-e2f023c8e3c4', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:19:51 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-e71e4bba-ce62-4c91-9dea-29459d991eb4 req-ea22ca84-017d-471b-86c1-0a2ebdcb319b tempest-TestMinimumBasicScenario-152630880 None] attachment_update completed successfully.
Aug 26 17:20:01 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=17,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:20:01 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=15,cinder:SELECT=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Flow 'volume_create_manager' (39cf377e-5f0a-4f71-8e7d-0404a0b6fbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69e15e9-7236-4c76-8756-a60dc1ee0a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69e15e9-7236-4c76-8756-a60dc1ee0a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1304758736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a897c343-72f6-4489-aa42-0c53241b8ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c6d22a3ce741fba52e8b6d16de2d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:20:21Z,use_quota=True,user_id='a8a533227ed241e2a2ae84fa7702afbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd46acbe-794e-45d2-9d0c-99712ac95eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd46acbe-794e-45d2-9d0c-99712ac95eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd8075c-2994-4c67-85c2-10cb4d171b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd8075c-2994-4c67-85c2-10cb4d171b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a897c343-72f6-4489-aa42-0c53241b8ea9', 'volume_name': 'volume-a897c343-72f6-4489-aa42-0c53241b8ea9', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa203691-6655-4255-be77-f8de525610a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa203691-6655-4255-be77-f8de525610a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e216395c-c90d-48e5-b87d-12f7b3f60b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:20 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Volume a897c343-72f6-4489-aa42-0c53241b8ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a897c343-72f6-4489-aa42-0c53241b8ea9', 'volume_size': 1}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1304758736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a897c343-72f6-4489-aa42-0c53241b8ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c6d22a3ce741fba52e8b6d16de2d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:20:21Z,use_quota=True,user_id='a8a533227ed241e2a2ae84fa7702afbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Creating volume a897c343-72f6-4489-aa42-0c53241b8ea9 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:20:20 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:20:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:20 devstack sudo[111782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 1073741824
Aug 26 17:20:20 devstack sudo[111782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:21 devstack sudo[111782]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 1073741824" returned: 0 in 0.488s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:21 devstack sudo[111787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9
Aug 26 17:20:21 devstack sudo[111787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:21 devstack sudo[111787]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9" returned: 0 in 0.342s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:20:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:20:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e216395c-c90d-48e5-b87d-12f7b3f60b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a897c343-72f6-4489-aa42-0c53241b8ea9', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0dbbde-f9b9-4bc4-a4fd-2b687a0266fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:21 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Volume volume-a897c343-72f6-4489-aa42-0c53241b8ea9 (a897c343-72f6-4489-aa42-0c53241b8ea9): created successfully
Aug 26 17:20:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0dbbde-f9b9-4bc4-a4fd-2b687a0266fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Flow 'volume_create_manager' (39cf377e-5f0a-4f71-8e7d-0404a0b6fbc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:20:21 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-bf731a9b-28a6-4684-8700-df3a55bc8927 tempest-TestStampPattern-1503934239 None] Created volume successfully.
Aug 26 17:20:31 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:20:31 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:20:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-8d95f2e2-dc87-47d7-b113-a6538618a6e5 req-a0dd9af9-4f59-4813-ba18-41abca1ba75a tempest-TestMinimumBasicScenario-152630880 None] Terminate volume connection completed successfully.
Aug 26 17:20:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-8d95f2e2-dc87-47d7-b113-a6538618a6e5 req-a0dd9af9-4f59-4813-ba18-41abca1ba75a tempest-TestMinimumBasicScenario-152630880 None] Deleting attachment ae7bfd88-9183-4f4a-8ef2-e2f023c8e3c4. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:20:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Acquiring lock "cinder-7816cfff-4cda-4660-8210-080d17515c3b-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:20:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Lock "cinder-7816cfff-4cda-4660-8210-080d17515c3b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:20:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Acquiring lock "cinder-quobyte-7816cfff-4cda-4660-8210-080d17515c3b" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:20:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Lock "cinder-quobyte-7816cfff-4cda-4660-8210-080d17515c3b" acquired by "delete_volume" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:20:37 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f83f5ef-64dc-4e15-99c4-66260d3125f3]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:20:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7816cfff-4cda-4660-8210-080d17515c3b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:37 devstack sudo[111956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7816cfff-4cda-4660-8210-080d17515c3b
Aug 26 17:20:37 devstack sudo[111956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:38 devstack sudo[111956]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7816cfff-4cda-4660-8210-080d17515c3b" returned: 0 in 0.367s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7816cfff-4cda-4660-8210-080d17515c3b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:38 devstack sudo[111961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7816cfff-4cda-4660-8210-080d17515c3b
Aug 26 17:20:38 devstack sudo[111961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:38 devstack sudo[111961]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7816cfff-4cda-4660-8210-080d17515c3b" returned: 0 in 0.247s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Lock "cinder-quobyte-7816cfff-4cda-4660-8210-080d17515c3b" released by "delete_volume" :: held 0.656s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Created reservations ['1df66fde-4079-435d-be25-403c2f8b6ead', '1e66f8bc-c34d-43a9-b892-e6a4329d6122', '94fd19d3-8d37-4526-8c11-6caf1f3b885c', 'a28bc29d-5c18-4ce0-87aa-e63f85177bfd'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:38 devstack sudo[111964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:20:38 devstack sudo[111964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:38 devstack sudo[111964]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.259s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:20:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Deleted volume successfully.
Aug 26 17:20:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-49e0cb93-aac0-4ad5-881a-f52e2282dc6a tempest-TestMinimumBasicScenario-152630880 None] Lock "cinder-7816cfff-4cda-4660-8210-080d17515c3b-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:20:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:20:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:20:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:20:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:20:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:20:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:20:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:42 devstack sudo[112023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:20:42 devstack sudo[112023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:42 devstack sudo[112023]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.278s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:20:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:20:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 29 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:20:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>, <Thread(Rabbit-heartbeat, started daemon 133049442341056)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:20:48 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:20:48 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-b6863658-48b6-4ae8-bf4b-9821233035dd req-2686c480-734f-42b2-9ca6-d3c30674cfde tempest-TestStampPattern-1503934239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-b6863658-48b6-4ae8-bf4b-9821233035dd req-2686c480-734f-42b2-9ca6-d3c30674cfde tempest-TestStampPattern-1503934239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-b6863658-48b6-4ae8-bf4b-9821233035dd req-2686c480-734f-42b2-9ca6-d3c30674cfde tempest-TestStampPattern-1503934239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-b6863658-48b6-4ae8-bf4b-9821233035dd req-2686c480-734f-42b2-9ca6-d3c30674cfde tempest-TestStampPattern-1503934239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-a897c343-72f6-4489-aa42-0c53241b8ea9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e7ad309-837a-470a-a76b-12998e61f564', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:20:52 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-b6863658-48b6-4ae8-bf4b-9821233035dd req-2686c480-734f-42b2-9ca6-d3c30674cfde tempest-TestStampPattern-1503934239 None] attachment_update completed successfully.
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Flow 'volume_create_manager' (7386a4c9-fdee-4a7b-a399-1402931e2888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cf18c3-c099-4fd9-b51c-762a534ed387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cf18c3-c099-4fd9-b51c-762a534ed387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1767198096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d15fc4-312e-4a23-a897-d207d1abe873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf7cedd61f54fd2b92493b7f96b69a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:20:53Z,use_quota=True,user_id='fddce1c497d741d2b2551429b015d258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2120f2e-8b92-46c3-b636-1073522c32fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2120f2e-8b92-46c3-b636-1073522c32fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007afb4a-99d1-4a90-a34c-c60772107a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007afb4a-99d1-4a90-a34c-c60772107a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d15fc4-312e-4a23-a897-d207d1abe873', 'volume_name': 'volume-75d15fc4-312e-4a23-a897-d207d1abe873', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88a1843-2906-4700-ad1b-3a66c4ff6b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88a1843-2906-4700-ad1b-3a66c4ff6b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20535a57-7c09-4e1d-a997-8c2d36839e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:52 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Volume 75d15fc4-312e-4a23-a897-d207d1abe873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d15fc4-312e-4a23-a897-d207d1abe873', 'volume_size': 1}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1767198096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d15fc4-312e-4a23-a897-d207d1abe873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf7cedd61f54fd2b92493b7f96b69a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:20:53Z,use_quota=True,user_id='fddce1c497d741d2b2551429b015d258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Creating volume 75d15fc4-312e-4a23-a897-d207d1abe873 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:20:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:20:53 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:53 devstack sudo[112431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 1073741824
Aug 26 17:20:53 devstack sudo[112431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:53 devstack sudo[112431]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 1073741824" returned: 0 in 0.489s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:53 devstack sudo[112438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873
Aug 26 17:20:53 devstack sudo[112438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:53 devstack sudo[112438]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873" returned: 0 in 0.243s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20535a57-7c09-4e1d-a997-8c2d36839e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d15fc4-312e-4a23-a897-d207d1abe873', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883b8f56-45d4-45bf-b641-3b0828b05da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:53 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Volume volume-75d15fc4-312e-4a23-a897-d207d1abe873 (75d15fc4-312e-4a23-a897-d207d1abe873): created successfully
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883b8f56-45d4-45bf-b641-3b0828b05da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Flow 'volume_create_manager' (7386a4c9-fdee-4a7b-a399-1402931e2888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:20:53 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6b4aea97-76a0-4ed9-9100-bde2d3389558 tempest-VolumeDependencyTests-1090524418 None] Created volume successfully.
Aug 26 17:20:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:20:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:20:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] Creating offline snapshot 55e5a90f-84e5-421b-8468-b0a240a9b819 of volume 75d15fc4-312e-4a23-a897-d207d1abe873 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:20:54 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[954865df-624b-41c5-9aa9-78cd5e3f2124]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:20:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:54 devstack sudo[112441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873
Aug 26 17:20:54 devstack sudo[112441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:54 devstack sudo[112441]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873" returned: 0 in 0.366s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:54 devstack sudo[112454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819 1G
Aug 26 17:20:54 devstack sudo[112454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:54 devstack sudo[112454]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819 1G" returned: 0 in 0.404s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d15fc4-312e-4a23-a897-d207d1abe873 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:54 devstack sudo[112463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d15fc4-312e-4a23-a897-d207d1abe873 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819
Aug 26 17:20:54 devstack sudo[112463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:55 devstack sudo[112463]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d15fc4-312e-4a23-a897-d207d1abe873 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819" returned: 0 in 0.296s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:55 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819 is being set with open permissions: ugo+rw
Aug 26 17:20:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:55 devstack sudo[112469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819
Aug 26 17:20:55 devstack sudo[112469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:55 devstack sudo[112469]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819" returned: 0 in 0.244s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:55 devstack sudo[112472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.info
Aug 26 17:20:55 devstack sudo[112472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:55 devstack sudo[112472]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.info" returned: 0 in 0.250s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:55 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.info is being set with open permissions: ugo+rw
Aug 26 17:20:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:55 devstack sudo[112475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.info
Aug 26 17:20:55 devstack sudo[112475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:56 devstack sudo[112475]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.info" returned: 0 in 0.248s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:20:56 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-29222f48-ec44-4513-b840-1960cdbda455 tempest-VolumeDependencyTests-1090524418 None] Create snapshot completed successfully
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Flow 'volume_create_manager' (5570ef39-1cfb-4462-95b3-d1349a1d7516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b5a266-7ea2-4212-a48b-612fb6736d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b5a266-7ea2-4212-a48b-612fb6736d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1903887216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcadd18f-3179-491a-96d9-8e77dc1aae17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf7cedd61f54fd2b92493b7f96b69a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=55e5a90f-84e5-421b-8468-b0a240a9b819,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:20:57Z,use_quota=True,user_id='fddce1c497d741d2b2551429b015d258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83bc212c-ae1e-41bd-9c6e-7266ca215b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83bc212c-ae1e-41bd-9c6e-7266ca215b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384831ae-fdf0-443c-a34d-1414b9091934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384831ae-fdf0-443c-a34d-1414b9091934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fcadd18f-3179-491a-96d9-8e77dc1aae17', 'volume_name': 'volume-fcadd18f-3179-491a-96d9-8e77dc1aae17', 'volume_size': 1, 'snapshot_id': '55e5a90f-84e5-421b-8468-b0a240a9b819'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c79642b-37f9-4d6d-833e-c0dc2348c25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c79642b-37f9-4d6d-833e-c0dc2348c25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c94d3e-3c0e-44df-827e-939542eb1277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:20:56 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Volume fcadd18f-3179-491a-96d9-8e77dc1aae17: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fcadd18f-3179-491a-96d9-8e77dc1aae17', 'volume_size': 1, 'snapshot_id': '55e5a90f-84e5-421b-8468-b0a240a9b819'}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "cinder-quobyte-55e5a90f-84e5-421b-8468-b0a240a9b819-fcadd18f-3179-491a-96d9-8e77dc1aae17" by "_create_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-quobyte-55e5a90f-84e5-421b-8468-b0a240a9b819-fcadd18f-3179-491a-96d9-8e77dc1aae17" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Creating volume fcadd18f-3179-491a-96d9-8e77dc1aae17 from snapshot 55e5a90f-84e5-421b-8468-b0a240a9b819 {{(pid=94125) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "cinder-quobyte-fcadd18f-3179-491a-96d9-8e77dc1aae17" by "_copy_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-quobyte-fcadd18f-3179-491a-96d9-8e77dc1aae17" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:20:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] snapshot: 55e5a90f-84e5-421b-8468-b0a240a9b819, volume: fcadd18f-3179-491a-96d9-8e77dc1aae17,  {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5dde0b-876d-40bb-9da8-344f545d0fc3]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:57 devstack sudo[112498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819
Aug 26 17:20:57 devstack sudo[112498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:57 devstack sudo[112498]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819" returned: 0 in 0.377s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75d15fc4-312e-4a23-a897-d207d1abe873(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3fa204-cc96-4e92-af95-d2bc0914ce3c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:57 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-6d28bd0c-709d-44f4-861f-16f6dfad782e req-be63fb52-a08c-46be-9f95-81e09c790d13 tempest-TestStampPattern-1503934239 None] Terminate volume connection completed successfully.
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-6d28bd0c-709d-44f4-861f-16f6dfad782e req-be63fb52-a08c-46be-9f95-81e09c790d13 tempest-TestStampPattern-1503934239 None] Deleting attachment 8e7ad309-837a-470a-a76b-12998e61f564. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:20:57 devstack sudo[112507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873
Aug 26 17:20:57 devstack sudo[112507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:57 devstack sudo[112507]: pam_unix(sudo:session): session closed for user root
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873" returned: 0 in 0.389s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Creating direct copy from snapshot {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG cinder.utils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Path /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17 not found in is_blk_device check {{(pid=94125) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 26 17:20:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:20:57 devstack sudo[112539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17
Aug 26 17:20:57 devstack sudo[112539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:20:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:21:01 devstack sudo[112539]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17" returned: 0 in 4.088s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:01 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:21:01 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Converted 1024.00 MB image at 250.37 MB/s
Aug 26 17:21:01 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17 is being set with open permissions: ugo+rw
Aug 26 17:21:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:01 devstack sudo[112552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17
Aug 26 17:21:01 devstack sudo[112552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:02 devstack sudo[112552]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17" returned: 0 in 0.241s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-quobyte-fcadd18f-3179-491a-96d9-8e77dc1aae17" released by "_copy_volume_from_snapshot" :: held 5.190s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-quobyte-55e5a90f-84e5-421b-8468-b0a240a9b819-fcadd18f-3179-491a-96d9-8e77dc1aae17" released by "_create_volume_from_snapshot" :: held 5.252s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.267s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.850s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] Creating offline snapshot 61735d11-0fb2-40e8-99cd-2665aa58fbef of volume a897c343-72f6-4489-aa42-0c53241b8ea9 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c94d3e-3c0e-44df-827e-939542eb1277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcadd18f-3179-491a-96d9-8e77dc1aae17', 'volume_size': 1, 'snapshot_id': '55e5a90f-84e5-421b-8468-b0a240a9b819'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f64cce4-2e18-4dbb-b595-e5a5385a7709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5da401-6dfb-4316-a6d9-529e52e562a4]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:02 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Volume volume-fcadd18f-3179-491a-96d9-8e77dc1aae17 (fcadd18f-3179-491a-96d9-8e77dc1aae17): created successfully
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f64cce4-2e18-4dbb-b595-e5a5385a7709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Flow 'volume_create_manager' (5570ef39-1cfb-4462-95b3-d1349a1d7516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:21:02 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-025cd297-4b7d-4ab8-a573-7d81b337232b tempest-VolumeDependencyTests-1090524418 None] Created volume successfully.
Aug 26 17:21:02 devstack sudo[112555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9
Aug 26 17:21:02 devstack sudo[112555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:02 devstack sudo[112555]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9" returned: 0 in 0.354s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:02 devstack sudo[112560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef 1G
Aug 26 17:21:02 devstack sudo[112560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:03 devstack sudo[112560]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef 1G" returned: 0 in 0.383s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a897c343-72f6-4489-aa42-0c53241b8ea9 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:03 devstack sudo[112565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a897c343-72f6-4489-aa42-0c53241b8ea9 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef
Aug 26 17:21:03 devstack sudo[112565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "cinder-55e5a90f-84e5-421b-8468-b0a240a9b819-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:21:03 devstack sudo[112565]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a897c343-72f6-4489-aa42-0c53241b8ea9 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef" returned: 0 in 0.314s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:03 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef is being set with open permissions: ugo+rw
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-55e5a90f-84e5-421b-8468-b0a240a9b819-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "cinder-quobyte-75d15fc4-312e-4a23-a897-d207d1abe873" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:21:03 devstack sudo[112571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef
Aug 26 17:21:03 devstack sudo[112571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-quobyte-75d15fc4-312e-4a23-a897-d207d1abe873" acquired by "delete_snapshot" :: waited 0.057s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "cinder-quobyte-55e5a90f-84e5-421b-8468-b0a240a9b819" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-quobyte-55e5a90f-84e5-421b-8468-b0a240a9b819" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Deleting offline snapshot 55e5a90f-84e5-421b-8468-b0a240a9b819 of volume 75d15fc4-312e-4a23-a897-d207d1abe873 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] snapshot_file for this snap is: volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf075fe-59c8-441e-9524-450b24c49016]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:03 devstack sudo[112573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819
Aug 26 17:21:03 devstack sudo[112573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:03 devstack sudo[112571]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef" returned: 0 in 0.258s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:03 devstack sudo[112576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.info
Aug 26 17:21:03 devstack sudo[112576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:03 devstack sudo[112573]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819" returned: 0 in 0.405s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75d15fc4-312e-4a23-a897-d207d1abe873(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:21:03 devstack sudo[112576]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.info" returned: 0 in 0.264s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:03 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.info is being set with open permissions: ugo+rw
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0df34b4-8338-4815-85e8-d57646152bad]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:21:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:03 devstack sudo[112582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.info
Aug 26 17:21:03 devstack sudo[112582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:04 devstack sudo[112583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873
Aug 26 17:21:04 devstack sudo[112583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:04 devstack sudo[112582]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.info" returned: 0 in 0.261s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:21:04 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5b8b1310-470d-4df4-abf2-fe3ffc82d0f8 tempest-TestStampPattern-1503934239 None] Create snapshot completed successfully
Aug 26 17:21:04 devstack sudo[112583]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873" returned: 0 in 0.529s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:04 devstack sudo[112591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819
Aug 26 17:21:04 devstack sudo[112591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:04 devstack sudo[112591]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819" returned: 0 in 0.354s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:04 devstack sudo[112597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819
Aug 26 17:21:04 devstack sudo[112597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:05 devstack sudo[112597]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873.55e5a90f-84e5-421b-8468-b0a240a9b819" returned: 0 in 0.251s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-quobyte-55e5a90f-84e5-421b-8468-b0a240a9b819" released by "_delete_snapshot" :: held 1.668s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-quobyte-75d15fc4-312e-4a23-a897-d207d1abe873" released by "delete_snapshot" :: held 1.688s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Created reservations ['8ea87423-1388-4cd1-bf04-6bcb934b7f68', '90177656-d598-4400-bb6f-86dd23bcca9a', '1bd382b6-8732-4c80-bba7-d05fc49e533e', 'ead0b799-216d-41d1-bac5-d4d66a2b1464'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:21:05 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Delete snapshot completed successfully.
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d0388745-203c-414d-bb13-b4c8cfc838ce tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-55e5a90f-84e5-421b-8468-b0a240a9b819-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "cinder-75d15fc4-312e-4a23-a897-d207d1abe873-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-75d15fc4-312e-4a23-a897-d207d1abe873-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "cinder-quobyte-75d15fc4-312e-4a23-a897-d207d1abe873" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-quobyte-75d15fc4-312e-4a23-a897-d207d1abe873" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[118b76d1-d2cc-4953-80f2-408631997798]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:05 devstack sudo[112600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873
Aug 26 17:21:05 devstack sudo[112600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:05 devstack sudo[112600]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873" returned: 0 in 0.383s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:05 devstack sudo[112605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873
Aug 26 17:21:05 devstack sudo[112605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:06 devstack sudo[112605]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-75d15fc4-312e-4a23-a897-d207d1abe873" returned: 0 in 0.251s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-quobyte-75d15fc4-312e-4a23-a897-d207d1abe873" released by "delete_volume" :: held 0.699s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Created reservations ['0c52f2e6-81df-455d-9a86-e9d6cd37175e', '5d3fe2dd-9850-40fb-851f-5199ac66543e', 'ab1515bc-5db2-44bd-989c-3d77d3843b79', '2cb5aa24-b361-46cf-af3b-9a1eb87c3554'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:06 devstack sudo[112615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:21:06 devstack sudo[112615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:06 devstack sudo[112615]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.259s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:21:06 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Deleted volume successfully.
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ce46a95d-c696-42a8-810f-362e5ffac64d tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-75d15fc4-312e-4a23-a897-d207d1abe873-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "cinder-fcadd18f-3179-491a-96d9-8e77dc1aae17-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-fcadd18f-3179-491a-96d9-8e77dc1aae17-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "cinder-quobyte-fcadd18f-3179-491a-96d9-8e77dc1aae17" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-quobyte-fcadd18f-3179-491a-96d9-8e77dc1aae17" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf93655-2f6c-448f-8abd-e1f23e95ee40]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:21:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:06 devstack sudo[112632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17
Aug 26 17:21:06 devstack sudo[112632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:07 devstack sudo[112632]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17" returned: 0 in 0.370s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:07 devstack sudo[112639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17
Aug 26 17:21:07 devstack sudo[112639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:07 devstack sudo[112639]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-fcadd18f-3179-491a-96d9-8e77dc1aae17" returned: 0 in 0.243s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-quobyte-fcadd18f-3179-491a-96d9-8e77dc1aae17" released by "delete_volume" :: held 0.649s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Created reservations ['ce18c011-f15b-4203-befb-27d11d41be02', 'c0d79ff3-4921-449b-b807-ed0a9a6bfc72', '2c335fc0-c0b4-4c4c-bae6-307221284068', 'b3d12565-9c99-4e2c-a2f7-c58923123066'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:07 devstack sudo[112644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:21:07 devstack sudo[112644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:07 devstack sudo[112644]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.259s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:21:07 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Deleted volume successfully.
Aug 26 17:21:07 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1f1c980c-6544-4f8f-839f-b325f6e4924c tempest-VolumeDependencyTests-1090524418 None] Lock "cinder-fcadd18f-3179-491a-96d9-8e77dc1aae17-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Flow 'volume_create_manager' (59c4483f-8700-40c1-b1ff-49a281c32fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af72292-3951-4092-ae85-e222250a3ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af72292-3951-4092-ae85-e222250a3ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1214741101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a75d891-71b0-4b62-a30d-b6636aac6d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c6d22a3ce741fba52e8b6d16de2d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=61735d11-0fb2-40e8-99cd-2665aa58fbef,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:21:11Z,use_quota=True,user_id='a8a533227ed241e2a2ae84fa7702afbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7615ded-e547-4e6b-b1d8-2c247e5c3613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7615ded-e547-4e6b-b1d8-2c247e5c3613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da1243c-7b4e-4391-9ac3-5475df54081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da1243c-7b4e-4391-9ac3-5475df54081a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a75d891-71b0-4b62-a30d-b6636aac6d17', 'volume_name': 'volume-7a75d891-71b0-4b62-a30d-b6636aac6d17', 'volume_size': 1, 'snapshot_id': '61735d11-0fb2-40e8-99cd-2665aa58fbef'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36e26e5-b12e-4545-a244-dfd9a4809d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36e26e5-b12e-4545-a244-dfd9a4809d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7e7fa8-9c33-4034-a7ed-3724ca7f789d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:21:11 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Volume 7a75d891-71b0-4b62-a30d-b6636aac6d17: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a75d891-71b0-4b62-a30d-b6636aac6d17', 'volume_size': 1, 'snapshot_id': '61735d11-0fb2-40e8-99cd-2665aa58fbef'}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Acquiring lock "cinder-quobyte-61735d11-0fb2-40e8-99cd-2665aa58fbef-7a75d891-71b0-4b62-a30d-b6636aac6d17" by "_create_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Lock "cinder-quobyte-61735d11-0fb2-40e8-99cd-2665aa58fbef-7a75d891-71b0-4b62-a30d-b6636aac6d17" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Creating volume 7a75d891-71b0-4b62-a30d-b6636aac6d17 from snapshot 61735d11-0fb2-40e8-99cd-2665aa58fbef {{(pid=94125) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Acquiring lock "cinder-quobyte-7a75d891-71b0-4b62-a30d-b6636aac6d17" by "_copy_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Lock "cinder-quobyte-7a75d891-71b0-4b62-a30d-b6636aac6d17" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] snapshot: 61735d11-0fb2-40e8-99cd-2665aa58fbef, volume: 7a75d891-71b0-4b62-a30d-b6636aac6d17,  {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3859f6f5-a81f-4ec7-b10a-c7d4a293c092]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:11 devstack sudo[112652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef
Aug 26 17:21:11 devstack sudo[112652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:11 devstack sudo[112652]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef" returned: 0 in 0.372s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a897c343-72f6-4489-aa42-0c53241b8ea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:21:12 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[47870ec2-9e55-494f-9609-48f8759431b4]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:21:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:12 devstack sudo[112657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9
Aug 26 17:21:12 devstack sudo[112657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:12 devstack sudo[112657]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9" returned: 0 in 0.443s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 26 17:21:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Creating direct copy from snapshot {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 26 17:21:12 devstack cinder-volume[94125]: DEBUG cinder.utils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Path /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17 not found in is_blk_device check {{(pid=94125) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 26 17:21:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:12 devstack sudo[112665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17
Aug 26 17:21:12 devstack sudo[112665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:17 devstack sudo[112665]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17" returned: 0 in 5.437s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:17 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:21:17 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Converted 1024.00 MB image at 188.30 MB/s
Aug 26 17:21:17 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17 is being set with open permissions: ugo+rw
Aug 26 17:21:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:17 devstack sudo[112679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17
Aug 26 17:21:17 devstack sudo[112679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:18 devstack sudo[112679]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17" returned: 0 in 0.280s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Lock "cinder-quobyte-7a75d891-71b0-4b62-a30d-b6636aac6d17" released by "_copy_volume_from_snapshot" :: held 6.630s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:21:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Lock "cinder-quobyte-61735d11-0fb2-40e8-99cd-2665aa58fbef-7a75d891-71b0-4b62-a30d-b6636aac6d17" released by "_create_volume_from_snapshot" :: held 6.757s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:21:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.773s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:21:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7e7fa8-9c33-4034-a7ed-3724ca7f789d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a75d891-71b0-4b62-a30d-b6636aac6d17', 'volume_size': 1, 'snapshot_id': '61735d11-0fb2-40e8-99cd-2665aa58fbef'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:21:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a98786-7d99-411a-a487-a1d57f740ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:21:18 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Volume volume-7a75d891-71b0-4b62-a30d-b6636aac6d17 (7a75d891-71b0-4b62-a30d-b6636aac6d17): created successfully
Aug 26 17:21:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a98786-7d99-411a-a487-a1d57f740ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:21:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Flow 'volume_create_manager' (59c4483f-8700-40c1-b1ff-49a281c32fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:21:18 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5b60e8f3-74cd-4034-836a-61a0a66c2c7b tempest-TestStampPattern-1503934239 None] Created volume successfully.
Aug 26 17:21:28 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=35,cinder:UPDATE=37,cinder:INSERT=11,cinder:DELETE=2 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:21:28 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=43,cinder:UPDATE=33,cinder:INSERT=6,cinder:DELETE=5 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:21:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:21:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:21:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:21:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:21:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:21:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:21:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:21:42 devstack sudo[112821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:21:42 devstack sudo[112821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:21:42 devstack sudo[112821]: pam_unix(sudo:session): session closed for user root
Aug 26 17:21:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.233s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:21:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:21:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:21:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 29 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:21:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>, <Thread(Rabbit-heartbeat, started daemon 133049442341056)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:21:52 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:21:52 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:22:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-48bcf629-09b3-4d64-a02b-dbdbcb18009d req-383a6afb-52dc-48d9-a236-95d51a044802 tempest-TestStampPattern-1503934239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-48bcf629-09b3-4d64-a02b-dbdbcb18009d req-383a6afb-52dc-48d9-a236-95d51a044802 tempest-TestStampPattern-1503934239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [req-48bcf629-09b3-4d64-a02b-dbdbcb18009d req-383a6afb-52dc-48d9-a236-95d51a044802 tempest-TestStampPattern-1503934239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-48bcf629-09b3-4d64-a02b-dbdbcb18009d req-383a6afb-52dc-48d9-a236-95d51a044802 tempest-TestStampPattern-1503934239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401', 'name': 'volume-7a75d891-71b0-4b62-a30d-b6636aac6d17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f070ec3-1cad-4279-a166-2dcdc92ea629', 'enforce_multipath': True} {{(pid=94125) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 17:22:01 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-48bcf629-09b3-4d64-a02b-dbdbcb18009d req-383a6afb-52dc-48d9-a236-95d51a044802 tempest-TestStampPattern-1503934239 None] attachment_update completed successfully.
Aug 26 17:22:04 devstack cinder-volume[94125]: INFO cinder.volume.manager [req-d9ce873a-7cd3-45f0-ba24-42147f892c6f req-4efdce17-f0d0-4cf6-9819-7f936057a169 tempest-TestStampPattern-1503934239 None] Terminate volume connection completed successfully.
Aug 26 17:22:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [req-d9ce873a-7cd3-45f0-ba24-42147f892c6f req-4efdce17-f0d0-4cf6-9819-7f936057a169 tempest-TestStampPattern-1503934239 None] Deleting attachment 5f070ec3-1cad-4279-a166-2dcdc92ea629. {{(pid=94125) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Acquiring lock "cinder-7a75d891-71b0-4b62-a30d-b6636aac6d17-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Lock "cinder-7a75d891-71b0-4b62-a30d-b6636aac6d17-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Acquiring lock "cinder-quobyte-7a75d891-71b0-4b62-a30d-b6636aac6d17" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Lock "cinder-quobyte-7a75d891-71b0-4b62-a30d-b6636aac6d17" acquired by "delete_volume" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4168bfdd-2c63-49c4-bfcc-ccb3ed07c2bd]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:13 devstack sudo[113321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17
Aug 26 17:22:13 devstack sudo[113321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:13 devstack sudo[113321]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17" returned: 0 in 0.354s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:13 devstack sudo[113326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17
Aug 26 17:22:13 devstack sudo[113326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:13 devstack sudo[113326]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7a75d891-71b0-4b62-a30d-b6636aac6d17" returned: 0 in 0.240s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Lock "cinder-quobyte-7a75d891-71b0-4b62-a30d-b6636aac6d17" released by "delete_volume" :: held 0.634s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Created reservations ['df6905b6-c459-4511-9cbb-0842082b71b1', '96996684-7c41-40a7-9b6d-6db3aaa16d9a', 'af389b94-43b4-4fad-b05a-d0efefee9188', '7ff37a43-59b5-4eca-8944-e2acbf2d4a66'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:13 devstack sudo[113329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:22:13 devstack sudo[113329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:14 devstack sudo[113329]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.256s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:22:14 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Deleted volume successfully.
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ec1426cf-1502-4927-a948-1550d98919a0 tempest-TestStampPattern-1503934239 None] Lock "cinder-7a75d891-71b0-4b62-a30d-b6636aac6d17-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Acquiring lock "cinder-61735d11-0fb2-40e8-99cd-2665aa58fbef-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Lock "cinder-61735d11-0fb2-40e8-99cd-2665aa58fbef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Acquiring lock "cinder-quobyte-a897c343-72f6-4489-aa42-0c53241b8ea9" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Lock "cinder-quobyte-a897c343-72f6-4489-aa42-0c53241b8ea9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Acquiring lock "cinder-quobyte-61735d11-0fb2-40e8-99cd-2665aa58fbef" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Lock "cinder-quobyte-61735d11-0fb2-40e8-99cd-2665aa58fbef" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Deleting offline snapshot 61735d11-0fb2-40e8-99cd-2665aa58fbef of volume a897c343-72f6-4489-aa42-0c53241b8ea9 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] snapshot_file for this snap is: volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ff4419-d615-40f1-a981-13204f1c4115]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:14 devstack sudo[113332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef
Aug 26 17:22:14 devstack sudo[113332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:14 devstack sudo[113332]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef" returned: 0 in 0.363s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a897c343-72f6-4489-aa42-0c53241b8ea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:22:15 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b934cea3-4d29-4022-9284-5c2352b06aee]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:15 devstack sudo[113337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9
Aug 26 17:22:15 devstack sudo[113337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:15 devstack sudo[113337]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9" returned: 0 in 0.534s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:15 devstack sudo[113342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef
Aug 26 17:22:15 devstack sudo[113342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:15 devstack sudo[113342]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef" returned: 0 in 0.319s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:15 devstack sudo[113347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef
Aug 26 17:22:15 devstack sudo[113347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:16 devstack sudo[113347]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9.61735d11-0fb2-40e8-99cd-2665aa58fbef" returned: 0 in 0.234s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Lock "cinder-quobyte-61735d11-0fb2-40e8-99cd-2665aa58fbef" released by "_delete_snapshot" :: held 1.552s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Lock "cinder-quobyte-a897c343-72f6-4489-aa42-0c53241b8ea9" released by "delete_snapshot" :: held 1.576s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:16 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Created reservations ['eb1f6f19-de3a-4140-a75f-a31565a20384', 'a2ff8cf5-5e8f-45ff-a26a-4e4d5ee63198', 'a30186b3-f317-449f-8361-38a7a887ff74', '02da4f41-4245-4a30-a7e3-6778f6f651f0'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:22:16 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Delete snapshot completed successfully.
Aug 26 17:22:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0398641b-ff0c-4113-b03d-7e494534b6bd tempest-TestStampPattern-1503934239 None] Lock "cinder-61735d11-0fb2-40e8-99cd-2665aa58fbef-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Acquiring lock "cinder-a897c343-72f6-4489-aa42-0c53241b8ea9-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Lock "cinder-a897c343-72f6-4489-aa42-0c53241b8ea9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Acquiring lock "cinder-quobyte-a897c343-72f6-4489-aa42-0c53241b8ea9" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Lock "cinder-quobyte-a897c343-72f6-4489-aa42-0c53241b8ea9" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[30287770-e789-4d28-a3f8-4cd6b28144de]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:20 devstack sudo[113381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9
Aug 26 17:22:20 devstack sudo[113381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:20 devstack sudo[113381]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9" returned: 0 in 0.378s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:20 devstack sudo[113386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9
Aug 26 17:22:20 devstack sudo[113386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:20 devstack sudo[113386]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-a897c343-72f6-4489-aa42-0c53241b8ea9" returned: 0 in 0.234s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Lock "cinder-quobyte-a897c343-72f6-4489-aa42-0c53241b8ea9" released by "delete_volume" :: held 0.672s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Created reservations ['c243bae3-db40-45ef-a435-20e72be7deef', '6d48bd5c-4b66-42aa-9373-5e81bf8f1c8a', '817da911-1554-431c-80ad-5cbb1bd6c9f1', '8794ddb9-8ca9-4181-9af2-0b7bedf9afbd'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:20 devstack sudo[113389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:22:20 devstack sudo[113389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:21 devstack sudo[113389]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.247s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:21 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:22:21 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Deleted volume successfully.
Aug 26 17:22:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-027e25eb-8727-45af-b5ce-e35d52cc453b tempest-TestStampPattern-1503934239 None] Lock "cinder-a897c343-72f6-4489-aa42-0c53241b8ea9-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:30 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=26,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:22:31 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=20,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Flow 'volume_create_manager' (f8543e0d-908e-48df-b882-b000153bd0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae347c0-b07f-4b34-96e5-1fb90ed9e05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae347c0-b07f-4b34-96e5-1fb90ed9e05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf89417-24bc-4bc6-a522-67b2f9fcce5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f34f84038441648a4f629edbf03822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:35Z,use_quota=True,user_id='58ee5a79eb5e4afe9cc3dc55e75eb504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78d5bd33-af1a-4490-b725-0f7dbb087f00),volume_type_id=78d5bd33-af1a-4490-b725-0f7dbb087f00)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1a88c2-9134-487c-b6dc-d2c1ce4980ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1a88c2-9134-487c-b6dc-d2c1ce4980ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad3e5fd-fb0a-48b4-a0b3-da20e7268644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.image.glance [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Creating Keystone auth plugin from conf {{(pid=94125) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad3e5fd-fb0a-48b4-a0b3-da20e7268644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2bf89417-24bc-4bc6-a522-67b2f9fcce5a', 'volume_name': 'volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a', 'volume_size': 1, 'image_id': '5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b15455913350d12489be773ffa6575a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64f34f84038441648a4f629edbf03822', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '64c7d16a67361a92d71cb66a2065a5b5db97ec7f2180d55bd2fccf98fa747c25428b3cb39042b56608d2bbd65e63a7ed811931e3326ed7d170fd589f24dbb690', 'id': '5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'created_at': datetime.datetime(2026, 8, 26, 15, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5490a7d1-8b77-48d6-ac8e-dc8496083ca4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd4595b0>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caee0439-98d2-4e96-9a39-f4af11001277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caee0439-98d2-4e96-9a39-f4af11001277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8185968c-20d5-4ae6-85d5-44a56a707551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:35 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Volume 2bf89417-24bc-4bc6-a522-67b2f9fcce5a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a', 'volume_size': 1, 'image_id': '5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b15455913350d12489be773ffa6575a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64f34f84038441648a4f629edbf03822', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '64c7d16a67361a92d71cb66a2065a5b5db97ec7f2180d55bd2fccf98fa747c25428b3cb39042b56608d2bbd65e63a7ed811931e3326ed7d170fd589f24dbb690', 'id': '5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'created_at': datetime.datetime(2026, 8, 26, 15, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5490a7d1-8b77-48d6-ac8e-dc8496083ca4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd4595b0>}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Trying to clone 2bf89417-24bc-4bc6-a522-67b2f9fcce5a from image 5490a7d1-8b77-48d6-ac8e-dc8496083ca4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'metadata': {}}]). {{(pid=94125) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 17:22:35 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Image download 0.00 MB at 0.00 MB/s
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[9805d2d1-274f-4f89-acc4-ca9eca5f6155]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:36 devstack sudo[113440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD
Aug 26 17:22:36 devstack sudo[113440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:36 devstack sudo[113440]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD" returned: 0 in 0.315s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:36 devstack sudo[113445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD
Aug 26 17:22:36 devstack sudo[113445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:36 devstack sudo[113445]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD" returned: 1 in 0.309s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:22:36 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Temporary image 5490a7d1-8b77-48d6-ac8e-dc8496083ca4 is fetched for user 58ee5a79eb5e4afe9cc3dc55e75eb504. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 17:22:36 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92943b4-2ba5-4440-8e54-b4c956b73e33]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:36 devstack sudo[113451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD
Aug 26 17:22:36 devstack sudo[113451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:36 devstack sudo[113451]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD" returned: 0 in 0.305s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:37 devstack sudo[113455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD
Aug 26 17:22:37 devstack sudo[113455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:37 devstack sudo[113455]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD" returned: 1 in 0.306s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf89417-24bc-4bc6-a522-67b2f9fcce5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f34f84038441648a4f629edbf03822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:35Z,use_quota=True,user_id='58ee5a79eb5e4afe9cc3dc55e75eb504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78d5bd33-af1a-4490-b725-0f7dbb087f00),volume_type_id=78d5bd33-af1a-4490-b725-0f7dbb087f00)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Creating volume 2bf89417-24bc-4bc6-a522-67b2f9fcce5a {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:22:37 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:37 devstack sudo[113460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a 1073741824
Aug 26 17:22:37 devstack sudo[113460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:37 devstack sudo[113460]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a 1073741824" returned: 0 in 0.391s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:37 devstack sudo[113465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a
Aug 26 17:22:37 devstack sudo[113465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:37 devstack sudo[113465]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a" returned: 0 in 0.232s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Attempting download of 5490a7d1-8b77-48d6-ac8e-dc8496083ca4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'metadata': {}}])) to volume 2bf89417-24bc-4bc6-a522-67b2f9fcce5a. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a704070a-10c2-47dd-a5ee-f0434e9d2e7e]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_5rykp8g9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:38 devstack sudo[113468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_5rykp8g9
Aug 26 17:22:38 devstack sudo[113468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:38 devstack sudo[113468]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_5rykp8g9" returned: 0 in 0.310s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_5rykp8g9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:38 devstack sudo[113472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_5rykp8g9
Aug 26 17:22:38 devstack sudo[113472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:38 devstack sudo[113472]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_5rykp8g9" returned: 1 in 0.322s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_5rykp8g9' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:22:38 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d418214-5904-4800-a565-b289f1ce80bc]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:38 devstack sudo[113476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD
Aug 26 17:22:38 devstack sudo[113476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:38 devstack sudo[113476]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD" returned: 0 in 0.307s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:39 devstack sudo[113482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD
Aug 26 17:22:39 devstack sudo[113482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:39 devstack sudo[113482]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD" returned: 1 in 0.307s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] 5490a7d1-8b77-48d6-ac8e-dc8496083ca4 was raw, converting to qcow2 {{(pid=94125) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:39 devstack sudo[113487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a
Aug 26 17:22:39 devstack sudo[113487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:39 devstack sudo[113487]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a" returned: 0 in 0.435s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5490a7d1-8b77-48d6-ac8e-dc8496083ca4_l8885db7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:22:39 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Converted 0.00 MB image at 0.00 MB/s
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:39 devstack sudo[113492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a 1G
Aug 26 17:22:39 devstack sudo[113492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:39 devstack sudo[113492]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a 1G" returned: 0 in 0.298s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Downloaded image 5490a7d1-8b77-48d6-ac8e-dc8496083ca4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'metadata': {}}])) to volume 2bf89417-24bc-4bc6-a522-67b2f9fcce5a successfully. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Temporary image 5490a7d1-8b77-48d6-ac8e-dc8496083ca4 for user 58ee5a79eb5e4afe9cc3dc55e75eb504 is deleted. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Marking volume 2bf89417-24bc-4bc6-a522-67b2f9fcce5a as bootable. {{(pid=94125) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Copying metadata from image 5490a7d1-8b77-48d6-ac8e-dc8496083ca4 to 2bf89417-24bc-4bc6-a522-67b2f9fcce5a. {{(pid=94125) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 17:22:39 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Creating volume glance metadata for volume 2bf89417-24bc-4bc6-a522-67b2f9fcce5a backed by image 5490a7d1-8b77-48d6-ac8e-dc8496083ca4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0b15455913350d12489be773ffa6575a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94125) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 17:22:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8185968c-20d5-4ae6-85d5-44a56a707551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a', 'volume_size': 1, 'image_id': '5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b15455913350d12489be773ffa6575a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64f34f84038441648a4f629edbf03822', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '64c7d16a67361a92d71cb66a2065a5b5db97ec7f2180d55bd2fccf98fa747c25428b3cb39042b56608d2bbd65e63a7ed811931e3326ed7d170fd589f24dbb690', 'id': '5490a7d1-8b77-48d6-ac8e-dc8496083ca4', 'created_at': datetime.datetime(2026, 8, 26, 15, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5490a7d1-8b77-48d6-ac8e-dc8496083ca4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd4595b0>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55252f0b-a541-475f-a5bc-a0b7f6339e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:40 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Volume volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a (2bf89417-24bc-4bc6-a522-67b2f9fcce5a): created successfully
Aug 26 17:22:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55252f0b-a541-475f-a5bc-a0b7f6339e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Flow 'volume_create_manager' (f8543e0d-908e-48df-b882-b000153bd0c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:40 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d6545078-a0fe-432b-bb9b-21920694f1b7 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Created volume successfully.
Aug 26 17:22:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Acquiring lock "cinder-2bf89417-24bc-4bc6-a522-67b2f9fcce5a-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Lock "cinder-2bf89417-24bc-4bc6-a522-67b2f9fcce5a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Acquiring lock "cinder-quobyte-2bf89417-24bc-4bc6-a522-67b2f9fcce5a" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Lock "cinder-quobyte-2bf89417-24bc-4bc6-a522-67b2f9fcce5a" acquired by "delete_volume" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:40 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[054e14b8-a515-45f0-a466-cdbc326067c2]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:40 devstack sudo[113497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a
Aug 26 17:22:40 devstack sudo[113497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:41 devstack sudo[113497]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a" returned: 0 in 0.340s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:41 devstack sudo[113502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a
Aug 26 17:22:41 devstack sudo[113502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:41 devstack sudo[113502]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-2bf89417-24bc-4bc6-a522-67b2f9fcce5a" returned: 0 in 0.250s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Lock "cinder-quobyte-2bf89417-24bc-4bc6-a522-67b2f9fcce5a" released by "delete_volume" :: held 0.627s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:41 devstack cinder-volume[94125]: WARNING cinder.quota [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:22:41 devstack cinder-volume[94125]: WARNING cinder.quota [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Created reservations ['e38b7304-809d-4bbb-b893-c3ba56fffe7a', '3a97f3b9-5874-47c3-8f51-69ab9ecf27fd', '322ed001-23d2-47c5-9670-d442c92e403c', '4b10d892-aaf0-4a6b-ae14-9e71f81be0fc'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:41 devstack sudo[113505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:22:41 devstack sudo[113505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:41 devstack sudo[113505]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.239s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:22:41 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Deleted volume successfully.
Aug 26 17:22:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-81c44883-fa02-40df-b6c4-9b8edb2e4878 tempest-VolumeAndVolumeTypeFromImageTest-243225608 None] Lock "cinder-2bf89417-24bc-4bc6-a522-67b2f9fcce5a-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:22:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:42 devstack sudo[113508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:22:42 devstack sudo[113508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:42 devstack sudo[113508]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.254s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:22:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:22:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 29 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:22:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>, <Thread(Rabbit-heartbeat, started daemon 133049442341056)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Flow 'volume_create_manager' (24de08ac-a310-4853-aee8-fb49ab50640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d073fb-b11e-46b6-826a-2c32aa74cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d073fb-b11e-46b6-826a-2c32aa74cd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1372521916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3c980f-d726-4e3e-8cd0-7f5cc28f6f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a34fecc4a034ee8b07132ebe6061593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:46Z,use_quota=True,user_id='9111069812e847e79bab38f276974057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8986425-ab63-4b76-a859-af8f470f4b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8986425-ab63-4b76-a859-af8f470f4b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f602f72a-b867-4304-81f8-cfa8c7e23530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f602f72a-b867-4304-81f8-cfa8c7e23530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af3c980f-d726-4e3e-8cd0-7f5cc28f6f06', 'volume_name': 'volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69013b26-38c5-41e4-8cf3-7e2c7da21895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69013b26-38c5-41e4-8cf3-7e2c7da21895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae37859-479a-44b4-83cb-bedf029e133a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:45 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume af3c980f-d726-4e3e-8cd0-7f5cc28f6f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06', 'volume_size': 1}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1372521916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3c980f-d726-4e3e-8cd0-7f5cc28f6f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a34fecc4a034ee8b07132ebe6061593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:46Z,use_quota=True,user_id='9111069812e847e79bab38f276974057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Creating volume af3c980f-d726-4e3e-8cd0-7f5cc28f6f06 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:22:45 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:22:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:45 devstack sudo[113511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06 1073741824
Aug 26 17:22:45 devstack sudo[113511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:46 devstack sudo[113511]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06 1073741824" returned: 0 in 0.393s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:46 devstack sudo[113516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06
Aug 26 17:22:46 devstack sudo[113516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:46 devstack sudo[113516]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06" returned: 0 in 0.236s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:22:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae37859-479a-44b4-83cb-bedf029e133a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366a9fb5-51d2-4c67-965a-0752a5c2dadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:46 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06 (af3c980f-d726-4e3e-8cd0-7f5cc28f6f06): created successfully
Aug 26 17:22:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366a9fb5-51d2-4c67-965a-0752a5c2dadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Flow 'volume_create_manager' (24de08ac-a310-4853-aee8-fb49ab50640d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2910c7bd-b31d-49f3-b559-61a0a1d6e330 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Created volume successfully.
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Flow 'volume_create_manager' (eec547d2-32ea-49bd-a46e-6e4723abd05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1df328a-8d34-43c2-9107-b736c32c39c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1df328a-8d34-43c2-9107-b736c32c39c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-729823551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018911f9-4c9d-459d-b245-9f3a85abf58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a34fecc4a034ee8b07132ebe6061593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:47Z,use_quota=True,user_id='9111069812e847e79bab38f276974057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aecb6ca-acf9-40f2-91d6-bc07a182bdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aecb6ca-acf9-40f2-91d6-bc07a182bdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e330b51-6d45-4502-8d5e-6f70191116a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e330b51-6d45-4502-8d5e-6f70191116a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018911f9-4c9d-459d-b245-9f3a85abf58b', 'volume_name': 'volume-018911f9-4c9d-459d-b245-9f3a85abf58b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb72ec1-3a72-4fdd-93d2-f3c8e7a41bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb72ec1-3a72-4fdd-93d2-f3c8e7a41bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5b3342-99fa-4bba-81b2-b3d94b66349a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume 018911f9-4c9d-459d-b245-9f3a85abf58b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018911f9-4c9d-459d-b245-9f3a85abf58b', 'volume_size': 1}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-729823551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018911f9-4c9d-459d-b245-9f3a85abf58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a34fecc4a034ee8b07132ebe6061593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:47Z,use_quota=True,user_id='9111069812e847e79bab38f276974057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Creating volume 018911f9-4c9d-459d-b245-9f3a85abf58b {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:22:47 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-018911f9-4c9d-459d-b245-9f3a85abf58b 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:47 devstack sudo[113520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-018911f9-4c9d-459d-b245-9f3a85abf58b 1073741824
Aug 26 17:22:47 devstack sudo[113520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Flow 'volume_create_manager' (e0db43d7-bbd3-4957-b6af-39a8e994cc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f813a0d4-1ed0-4253-8f20-c39b350a0133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f813a0d4-1ed0-4253-8f20-c39b350a0133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-122514796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cdb714-f3d1-4aab-9bde-232798844b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a34fecc4a034ee8b07132ebe6061593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:47Z,use_quota=True,user_id='9111069812e847e79bab38f276974057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87a2b1a-223f-4f4e-b34e-0ea3b8cf234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87a2b1a-223f-4f4e-b34e-0ea3b8cf234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd815ad8-7983-48de-be80-0b58a6c3ce72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd815ad8-7983-48de-be80-0b58a6c3ce72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51cdb714-f3d1-4aab-9bde-232798844b68', 'volume_name': 'volume-51cdb714-f3d1-4aab-9bde-232798844b68', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d695d618-68ae-41c9-aaba-5b1e8a629c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d695d618-68ae-41c9-aaba-5b1e8a629c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0736280-5fc6-45f0-8977-78e081aae147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume 51cdb714-f3d1-4aab-9bde-232798844b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51cdb714-f3d1-4aab-9bde-232798844b68', 'volume_size': 1}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:47 devstack sudo[113520]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-018911f9-4c9d-459d-b245-9f3a85abf58b 1073741824" returned: 0 in 0.475s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-018911f9-4c9d-459d-b245-9f3a85abf58b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:47 devstack sudo[113526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-018911f9-4c9d-459d-b245-9f3a85abf58b
Aug 26 17:22:47 devstack sudo[113526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Flow 'volume_create_manager' (2e4e10d9-2896-4ccf-b06a-756a2a59ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336f033c-2202-4454-b6a9-5cc6fc1f9b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336f033c-2202-4454-b6a9-5cc6fc1f9b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2028008847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7316f873-64c6-4df4-a2e5-7b52efb6f0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a34fecc4a034ee8b07132ebe6061593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:48Z,use_quota=True,user_id='9111069812e847e79bab38f276974057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2375b768-8a55-437c-8181-8da5b268643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2375b768-8a55-437c-8181-8da5b268643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccc842c-faa0-4a27-9270-49ad6fc119f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccc842c-faa0-4a27-9270-49ad6fc119f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7316f873-64c6-4df4-a2e5-7b52efb6f0bb', 'volume_name': 'volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fb69fa-643e-4590-8899-3d4ae01195c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fb69fa-643e-4590-8899-3d4ae01195c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b09bfacc-80db-4fee-ba21-f5ca45e685e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:47 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume 7316f873-64c6-4df4-a2e5-7b52efb6f0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb', 'volume_size': 1}
Aug 26 17:22:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:48 devstack sudo[113526]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-018911f9-4c9d-459d-b245-9f3a85abf58b" returned: 0 in 0.251s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.416s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-122514796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cdb714-f3d1-4aab-9bde-232798844b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a34fecc4a034ee8b07132ebe6061593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:47Z,use_quota=True,user_id='9111069812e847e79bab38f276974057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Creating volume 51cdb714-f3d1-4aab-9bde-232798844b68 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:22:48 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-51cdb714-f3d1-4aab-9bde-232798844b68 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5b3342-99fa-4bba-81b2-b3d94b66349a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018911f9-4c9d-459d-b245-9f3a85abf58b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e3b1dc-5355-4a2c-a5f0-fe763e404d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:48 devstack sudo[113529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-51cdb714-f3d1-4aab-9bde-232798844b68 1073741824
Aug 26 17:22:48 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume volume-018911f9-4c9d-459d-b245-9f3a85abf58b (018911f9-4c9d-459d-b245-9f3a85abf58b): created successfully
Aug 26 17:22:48 devstack sudo[113529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e3b1dc-5355-4a2c-a5f0-fe763e404d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Flow 'volume_create_manager' (eec547d2-32ea-49bd-a46e-6e4723abd05b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:48 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-42fe8466-b2e4-4191-b418-ad319e2a6c0e tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Created volume successfully.
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Flow 'volume_create_manager' (3248bb2b-efb2-48d4-95f9-6664fd5cd95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28164310-cc14-47d1-9816-6872337db9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28164310-cc14-47d1-9816-6872337db9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-755129698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c159842-421a-46fc-903c-abc5c4e93425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a34fecc4a034ee8b07132ebe6061593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:48Z,use_quota=True,user_id='9111069812e847e79bab38f276974057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75704ab-2665-4790-b393-0f2bc3911957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75704ab-2665-4790-b393-0f2bc3911957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ea58d1-6a10-4cc4-a707-660f17fa3d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ea58d1-6a10-4cc4-a707-660f17fa3d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c159842-421a-46fc-903c-abc5c4e93425', 'volume_name': 'volume-3c159842-421a-46fc-903c-abc5c4e93425', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b13f7fd-4cdb-42e4-b2fa-41cf5651c26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b13f7fd-4cdb-42e4-b2fa-41cf5651c26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c450e952-0dc6-4c36-8912-4d3682aa5cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:48 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume 3c159842-421a-46fc-903c-abc5c4e93425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c159842-421a-46fc-903c-abc5c4e93425', 'volume_size': 1}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:48 devstack sudo[113529]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-51cdb714-f3d1-4aab-9bde-232798844b68 1073741824" returned: 0 in 0.504s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-51cdb714-f3d1-4aab-9bde-232798844b68 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:22:48 devstack sudo[113535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-51cdb714-f3d1-4aab-9bde-232798844b68
Aug 26 17:22:48 devstack sudo[113535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Flow 'volume_create_manager' (b0205e74-946b-48fe-a555-048fde4f2e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700811f4-0fc6-4149-9c18-2a308d5232f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700811f4-0fc6-4149-9c18-2a308d5232f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-85072192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c144d53-542c-408e-a1f3-e94dd307ed0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a34fecc4a034ee8b07132ebe6061593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:49Z,use_quota=True,user_id='9111069812e847e79bab38f276974057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8d1848-0bc8-467d-a158-ede5eefceb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8d1848-0bc8-467d-a158-ede5eefceb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06578515-d83f-4d8d-8251-c7728580c4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06578515-d83f-4d8d-8251-c7728580c4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c144d53-542c-408e-a1f3-e94dd307ed0b', 'volume_name': 'volume-4c144d53-542c-408e-a1f3-e94dd307ed0b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866e6aa8-c513-46e4-bcec-a7995a07f308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866e6aa8-c513-46e4-bcec-a7995a07f308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3f4667-e706-455f-8733-96be60bd380e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:48 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume 4c144d53-542c-408e-a1f3-e94dd307ed0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c144d53-542c-408e-a1f3-e94dd307ed0b', 'volume_size': 1}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:48 devstack sudo[113535]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-51cdb714-f3d1-4aab-9bde-232798844b68" returned: 0 in 0.246s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2028008847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7316f873-64c6-4df4-a2e5-7b52efb6f0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a34fecc4a034ee8b07132ebe6061593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:48Z,use_quota=True,user_id='9111069812e847e79bab38f276974057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Creating volume 7316f873-64c6-4df4-a2e5-7b52efb6f0bb {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:22:48 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0736280-5fc6-45f0-8977-78e081aae147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51cdb714-f3d1-4aab-9bde-232798844b68', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:48 devstack sudo[113538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb 1073741824
Aug 26 17:22:48 devstack sudo[113538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a59b44-bbba-43eb-bd6e-a07eb223646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:48 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume volume-51cdb714-f3d1-4aab-9bde-232798844b68 (51cdb714-f3d1-4aab-9bde-232798844b68): created successfully
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a59b44-bbba-43eb-bd6e-a07eb223646a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:48 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Flow 'volume_create_manager' (e0db43d7-bbd3-4957-b6af-39a8e994cc82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:48 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-18e9ae5a-fb54-4467-b97d-9fba45004ccb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Created volume successfully.
Aug 26 17:22:49 devstack sudo[113538]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb 1073741824" returned: 0 in 0.405s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:49 devstack sudo[113544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb
Aug 26 17:22:49 devstack sudo[113544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:49 devstack sudo[113544]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb" returned: 0 in 0.242s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-755129698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c159842-421a-46fc-903c-abc5c4e93425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a34fecc4a034ee8b07132ebe6061593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:48Z,use_quota=True,user_id='9111069812e847e79bab38f276974057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Creating volume 3c159842-421a-46fc-903c-abc5c4e93425 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:22:49 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3c159842-421a-46fc-903c-abc5c4e93425 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:49 devstack sudo[113547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3c159842-421a-46fc-903c-abc5c4e93425 1073741824
Aug 26 17:22:49 devstack sudo[113547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b09bfacc-80db-4fee-ba21-f5ca45e685e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23dd3b75-aa24-47fb-8d1b-ddeaff9e602e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:49 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb (7316f873-64c6-4df4-a2e5-7b52efb6f0bb): created successfully
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23dd3b75-aa24-47fb-8d1b-ddeaff9e602e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Flow 'volume_create_manager' (2e4e10d9-2896-4ccf-b06a-756a2a59ac40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:49 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-73fffffb-9b37-4a98-b6c6-a6faec8ca1cd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Created volume successfully.
Aug 26 17:22:49 devstack sudo[113547]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3c159842-421a-46fc-903c-abc5c4e93425 1073741824" returned: 0 in 0.421s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3c159842-421a-46fc-903c-abc5c4e93425 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:49 devstack sudo[113553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3c159842-421a-46fc-903c-abc5c4e93425
Aug 26 17:22:49 devstack sudo[113553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:50 devstack sudo[113553]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3c159842-421a-46fc-903c-abc5c4e93425" returned: 0 in 0.234s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.539s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-85072192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c144d53-542c-408e-a1f3-e94dd307ed0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a34fecc4a034ee8b07132ebe6061593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:22:49Z,use_quota=True,user_id='9111069812e847e79bab38f276974057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Creating volume 4c144d53-542c-408e-a1f3-e94dd307ed0b {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:22:50 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c144d53-542c-408e-a1f3-e94dd307ed0b 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c450e952-0dc6-4c36-8912-4d3682aa5cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c159842-421a-46fc-903c-abc5c4e93425', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:50 devstack sudo[113556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c144d53-542c-408e-a1f3-e94dd307ed0b 1073741824
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadf2bea-1f95-4922-a2d1-33ea2454d883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:50 devstack sudo[113556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:50 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume volume-3c159842-421a-46fc-903c-abc5c4e93425 (3c159842-421a-46fc-903c-abc5c4e93425): created successfully
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadf2bea-1f95-4922-a2d1-33ea2454d883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Flow 'volume_create_manager' (3248bb2b-efb2-48d4-95f9-6664fd5cd95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:50 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-cf51852f-afc5-487f-9643-314b48cb55ad tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Created volume successfully.
Aug 26 17:22:50 devstack sudo[113556]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c144d53-542c-408e-a1f3-e94dd307ed0b 1073741824" returned: 0 in 0.427s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c144d53-542c-408e-a1f3-e94dd307ed0b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:50 devstack sudo[113561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c144d53-542c-408e-a1f3-e94dd307ed0b
Aug 26 17:22:50 devstack sudo[113561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:50 devstack sudo[113561]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c144d53-542c-408e-a1f3-e94dd307ed0b" returned: 0 in 0.240s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3f4667-e706-455f-8733-96be60bd380e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c144d53-542c-408e-a1f3-e94dd307ed0b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74bea03-900a-4aab-ab6c-11f7f6d6e925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:22:50 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Volume volume-4c144d53-542c-408e-a1f3-e94dd307ed0b (4c144d53-542c-408e-a1f3-e94dd307ed0b): created successfully
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74bea03-900a-4aab-ab6c-11f7f6d6e925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:22:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Flow 'volume_create_manager' (b0205e74-946b-48fe-a555-048fde4f2e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:22:50 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5d931e9a-c3df-4696-a03a-487e5027b445 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Created volume successfully.
Aug 26 17:22:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "cinder-4c144d53-542c-408e-a1f3-e94dd307ed0b-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-4c144d53-542c-408e-a1f3-e94dd307ed0b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "cinder-quobyte-4c144d53-542c-408e-a1f3-e94dd307ed0b" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-quobyte-4c144d53-542c-408e-a1f3-e94dd307ed0b" acquired by "delete_volume" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a928a0-348b-466a-b0f5-f8fdd30a1308]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c144d53-542c-408e-a1f3-e94dd307ed0b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:52 devstack sudo[113564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c144d53-542c-408e-a1f3-e94dd307ed0b
Aug 26 17:22:52 devstack sudo[113564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:52 devstack sudo[113564]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c144d53-542c-408e-a1f3-e94dd307ed0b" returned: 0 in 0.343s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c144d53-542c-408e-a1f3-e94dd307ed0b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:52 devstack sudo[113569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c144d53-542c-408e-a1f3-e94dd307ed0b
Aug 26 17:22:52 devstack sudo[113569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:52 devstack sudo[113569]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c144d53-542c-408e-a1f3-e94dd307ed0b" returned: 0 in 0.235s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-quobyte-4c144d53-542c-408e-a1f3-e94dd307ed0b" released by "delete_volume" :: held 0.614s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Created reservations ['9ef85cf5-5c2d-4b00-9763-3487ad198fcf', '1ecd8c89-0308-47d4-814d-e4843962a26c', '05a7e90e-fb43-426c-b336-232a3fccc188', '73ac6eb3-e70c-46a5-a7ec-591c3696fc0e'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:52 devstack sudo[113572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:22:52 devstack sudo[113572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:52 devstack sudo[113572]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.242s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:52 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:22:52 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Deleted volume successfully.
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-abcb1587-d068-4ff0-989c-ed66a4f1f2dd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-4c144d53-542c-408e-a1f3-e94dd307ed0b-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "cinder-3c159842-421a-46fc-903c-abc5c4e93425-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-3c159842-421a-46fc-903c-abc5c4e93425-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "cinder-quobyte-3c159842-421a-46fc-903c-abc5c4e93425" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-quobyte-3c159842-421a-46fc-903c-abc5c4e93425" acquired by "delete_volume" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab26451-b8e4-4286-ab8c-f8db1359b285]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3c159842-421a-46fc-903c-abc5c4e93425 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:53 devstack sudo[113575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3c159842-421a-46fc-903c-abc5c4e93425
Aug 26 17:22:53 devstack sudo[113575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:53 devstack sudo[113575]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3c159842-421a-46fc-903c-abc5c4e93425" returned: 0 in 0.344s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3c159842-421a-46fc-903c-abc5c4e93425 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:53 devstack sudo[113580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3c159842-421a-46fc-903c-abc5c4e93425
Aug 26 17:22:53 devstack sudo[113580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:53 devstack sudo[113580]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3c159842-421a-46fc-903c-abc5c4e93425" returned: 0 in 0.236s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-quobyte-3c159842-421a-46fc-903c-abc5c4e93425" released by "delete_volume" :: held 0.620s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Created reservations ['09e8a77c-8ddc-4974-bc5b-7886ea52278a', '6ab656b8-692c-4ea0-b0ac-28713d492d73', 'd7b547df-fd37-4138-a203-649ee842aff8', 'fdeee4c5-2936-48ac-85d2-a711fb599a14'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:53 devstack sudo[113583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:22:53 devstack sudo[113583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:54 devstack sudo[113583]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.239s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:22:54 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Deleted volume successfully.
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6e70dbe1-9cc9-456a-94c3-33922c56d4bd tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-3c159842-421a-46fc-903c-abc5c4e93425-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "cinder-7316f873-64c6-4df4-a2e5-7b52efb6f0bb-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-7316f873-64c6-4df4-a2e5-7b52efb6f0bb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "cinder-quobyte-7316f873-64c6-4df4-a2e5-7b52efb6f0bb" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-quobyte-7316f873-64c6-4df4-a2e5-7b52efb6f0bb" acquired by "delete_volume" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[016e23a0-df42-4dc1-8668-054130c109c6]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:54 devstack sudo[113586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb
Aug 26 17:22:54 devstack sudo[113586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:54 devstack sudo[113586]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb" returned: 0 in 0.351s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:54 devstack sudo[113591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb
Aug 26 17:22:54 devstack sudo[113591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:54 devstack sudo[113591]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7316f873-64c6-4df4-a2e5-7b52efb6f0bb" returned: 0 in 0.243s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-quobyte-7316f873-64c6-4df4-a2e5-7b52efb6f0bb" released by "delete_volume" :: held 0.629s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:54 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Created reservations ['47d74f5c-e139-4273-8b09-ea058f124c8c', 'e6a10bc2-b698-4989-ab1f-cd5f75367ad0', '3bfb5e9a-e5c6-4de4-b5dd-87b388b31343', 'aad4919d-4a25-47e5-a33b-dc0cc4751a6e'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:55 devstack sudo[113594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:22:55 devstack sudo[113594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:55 devstack sudo[113594]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.239s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:22:55 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Deleted volume successfully.
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-22f12078-93a7-429b-9fe4-b8006daa77cb tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-7316f873-64c6-4df4-a2e5-7b52efb6f0bb-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "cinder-51cdb714-f3d1-4aab-9bde-232798844b68-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-51cdb714-f3d1-4aab-9bde-232798844b68-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "cinder-quobyte-51cdb714-f3d1-4aab-9bde-232798844b68" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-quobyte-51cdb714-f3d1-4aab-9bde-232798844b68" acquired by "delete_volume" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdd440e-f4ac-4cbb-ac14-6d0dc8ed7a4f]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-51cdb714-f3d1-4aab-9bde-232798844b68 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:55 devstack sudo[113597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-51cdb714-f3d1-4aab-9bde-232798844b68
Aug 26 17:22:55 devstack sudo[113597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:55 devstack sudo[113597]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-51cdb714-f3d1-4aab-9bde-232798844b68" returned: 0 in 0.338s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-51cdb714-f3d1-4aab-9bde-232798844b68 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:55 devstack sudo[113603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-51cdb714-f3d1-4aab-9bde-232798844b68
Aug 26 17:22:55 devstack sudo[113603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:56 devstack sudo[113603]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-51cdb714-f3d1-4aab-9bde-232798844b68" returned: 0 in 0.232s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-quobyte-51cdb714-f3d1-4aab-9bde-232798844b68" released by "delete_volume" :: held 0.607s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Created reservations ['7783f0ce-955a-4dd4-89ad-d61f53072ada', '5b19e27c-70e9-49f0-88b3-d4fb22a97d82', 'b139bb0e-8a7d-4cec-8a02-2c5d06d91f78', '80f47f94-7643-40e8-8950-3b55fdbfa7a2'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:56 devstack sudo[113606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:22:56 devstack sudo[113606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:56 devstack sudo[113606]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.243s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:22:56 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Deleted volume successfully.
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a7ecf3ae-c85b-44d9-a5c7-263c93246c64 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-51cdb714-f3d1-4aab-9bde-232798844b68-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "cinder-018911f9-4c9d-459d-b245-9f3a85abf58b-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-018911f9-4c9d-459d-b245-9f3a85abf58b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "cinder-quobyte-018911f9-4c9d-459d-b245-9f3a85abf58b" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-quobyte-018911f9-4c9d-459d-b245-9f3a85abf58b" acquired by "delete_volume" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[04129b12-4c3e-453d-b98a-b91ed71ce314]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-018911f9-4c9d-459d-b245-9f3a85abf58b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:56 devstack sudo[113610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-018911f9-4c9d-459d-b245-9f3a85abf58b
Aug 26 17:22:56 devstack sudo[113610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:57 devstack sudo[113610]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-018911f9-4c9d-459d-b245-9f3a85abf58b" returned: 0 in 0.349s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-018911f9-4c9d-459d-b245-9f3a85abf58b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:57 devstack sudo[113615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-018911f9-4c9d-459d-b245-9f3a85abf58b
Aug 26 17:22:57 devstack sudo[113615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:57 devstack sudo[113615]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-018911f9-4c9d-459d-b245-9f3a85abf58b" returned: 0 in 0.237s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-quobyte-018911f9-4c9d-459d-b245-9f3a85abf58b" released by "delete_volume" :: held 0.624s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Created reservations ['0fb1f2e2-b3c5-44ec-b2a5-ea481d66d09b', '531ae29e-c08d-4ff1-b033-2b33396ce675', '47009886-73a6-4d32-9cdc-31478465319a', '5ce4de69-0b4f-4b4b-89e2-677be82e4ee4'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:57 devstack sudo[113618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:22:57 devstack sudo[113618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:57 devstack sudo[113618]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.243s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:22:57 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Deleted volume successfully.
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-57aa4e58-1024-4bdd-8169-8bb025863383 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-018911f9-4c9d-459d-b245-9f3a85abf58b-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "cinder-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "cinder-quobyte-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-quobyte-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c422551-87c9-468b-8b00-730a6565a9ca]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:22:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:57 devstack sudo[113621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06
Aug 26 17:22:57 devstack sudo[113621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:58 devstack sudo[113621]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06" returned: 0 in 0.347s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:58 devstack sudo[113626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06
Aug 26 17:22:58 devstack sudo[113626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:58 devstack sudo[113626]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06" returned: 0 in 0.246s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-quobyte-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06" released by "delete_volume" :: held 0.631s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Created reservations ['6f14d65d-ea49-4ece-aef3-b50b9ecdc938', 'c825d367-9629-40fb-a5af-00b5a700d25a', 'f03cad5d-4c2b-44e7-a38e-f93746952928', '648e16c6-737c-47d9-a845-b8d1d7a852a9'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:22:58 devstack sudo[113629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:22:58 devstack sudo[113629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:22:58 devstack sudo[113629]: pam_unix(sudo:session): session closed for user root
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.242s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:22:58 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Deleted volume successfully.
Aug 26 17:22:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-06ef2e9c-ac30-4355-9187-e2cf8de4a8a9 tempest-CreateVolumesFromSourceVolumeTest-1574309736 None] Lock "cinder-af3c980f-d726-4e3e-8cd0-7f5cc28f6f06-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Flow 'volume_create_manager' (a3216d3d-c7b7-41d5-abe7-155925feac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbc2a2b-2c2e-4380-a659-27df46b7765d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbc2a2b-2c2e-4380-a659-27df46b7765d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760982394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3682fb-0433-416b-b7e8-25242d044f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbbfa4a67e104e3e9326c330643112c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:23:02Z,use_quota=True,user_id='c3682ef3356b4723a87e342f70a72203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34893196-5325-43ab-b7e2-ad8edb50f5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34893196-5325-43ab-b7e2-ad8edb50f5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402299ff-714a-457c-af1b-81ecaeb5c64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402299ff-714a-457c-af1b-81ecaeb5c64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3682fb-0433-416b-b7e8-25242d044f9b', 'volume_name': 'volume-5e3682fb-0433-416b-b7e8-25242d044f9b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3804c050-40bd-403f-8856-afc916fd291f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3804c050-40bd-403f-8856-afc916fd291f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39476ac9-fe2f-48d6-9c68-656a300e78a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:02 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Volume 5e3682fb-0433-416b-b7e8-25242d044f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3682fb-0433-416b-b7e8-25242d044f9b', 'volume_size': 1}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760982394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3682fb-0433-416b-b7e8-25242d044f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbbfa4a67e104e3e9326c330643112c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:23:02Z,use_quota=True,user_id='c3682ef3356b4723a87e342f70a72203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Creating volume 5e3682fb-0433-416b-b7e8-25242d044f9b {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:23:02 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5e3682fb-0433-416b-b7e8-25242d044f9b 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:02 devstack sudo[113634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5e3682fb-0433-416b-b7e8-25242d044f9b 1073741824
Aug 26 17:23:02 devstack sudo[113634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:02 devstack sudo[113634]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5e3682fb-0433-416b-b7e8-25242d044f9b 1073741824" returned: 0 in 0.408s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5e3682fb-0433-416b-b7e8-25242d044f9b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:02 devstack sudo[113639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5e3682fb-0433-416b-b7e8-25242d044f9b
Aug 26 17:23:02 devstack sudo[113639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:02 devstack sudo[113639]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5e3682fb-0433-416b-b7e8-25242d044f9b" returned: 0 in 0.233s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39476ac9-fe2f-48d6-9c68-656a300e78a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3682fb-0433-416b-b7e8-25242d044f9b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d68401-25c5-496b-b389-0f03c7fa8231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:02 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Volume volume-5e3682fb-0433-416b-b7e8-25242d044f9b (5e3682fb-0433-416b-b7e8-25242d044f9b): created successfully
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d68401-25c5-496b-b389-0f03c7fa8231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Flow 'volume_create_manager' (a3216d3d-c7b7-41d5-abe7-155925feac18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:23:02 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-02db415e-d494-453c-afe9-188246874ed6 tempest-ProjectReaderTests-312170268 None] Created volume successfully.
Aug 26 17:23:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Acquiring lock "cinder-5e3682fb-0433-416b-b7e8-25242d044f9b-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Lock "cinder-5e3682fb-0433-416b-b7e8-25242d044f9b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Acquiring lock "cinder-quobyte-5e3682fb-0433-416b-b7e8-25242d044f9b" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Lock "cinder-quobyte-5e3682fb-0433-416b-b7e8-25242d044f9b" acquired by "delete_volume" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:03 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a56650-c374-481b-b9b3-c6a81925f10e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:23:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5e3682fb-0433-416b-b7e8-25242d044f9b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:03 devstack sudo[113642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5e3682fb-0433-416b-b7e8-25242d044f9b
Aug 26 17:23:03 devstack sudo[113642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:03 devstack sudo[113642]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5e3682fb-0433-416b-b7e8-25242d044f9b" returned: 0 in 0.346s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5e3682fb-0433-416b-b7e8-25242d044f9b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:03 devstack sudo[113647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5e3682fb-0433-416b-b7e8-25242d044f9b
Aug 26 17:23:03 devstack sudo[113647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:03 devstack sudo[113647]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5e3682fb-0433-416b-b7e8-25242d044f9b" returned: 0 in 0.229s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Lock "cinder-quobyte-5e3682fb-0433-416b-b7e8-25242d044f9b" released by "delete_volume" :: held 0.612s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Created reservations ['8d988945-743b-4510-96fb-d112673f562b', '70c95e76-fd8f-4c02-9684-8b710c0f1438', '2c480312-a0e2-478d-94be-9b60505491ab', '2190d3b9-2d74-4e52-989d-4041cb261480'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:04 devstack sudo[113650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:23:04 devstack sudo[113650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:04 devstack sudo[113650]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.238s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:23:04 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Deleted volume successfully.
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d7d70db5-833d-47ec-92b5-87c2b73eb4bc tempest-ProjectReaderTests-312170268 None] Lock "cinder-5e3682fb-0433-416b-b7e8-25242d044f9b-delete_volume" released by "delete_volume" :: held 1.021s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Flow 'volume_create_manager' (104665d1-b001-49b9-b8ec-81e0ef84079c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0173987-800d-40bc-9dde-602e271c669c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0173987-800d-40bc-9dde-602e271c669c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356701272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b25c4c-566c-41ab-ba5b-7e39686def1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbbfa4a67e104e3e9326c330643112c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:23:05Z,use_quota=True,user_id='c3682ef3356b4723a87e342f70a72203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344cfad6-a02d-48eb-a20c-7eeaf4b27331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344cfad6-a02d-48eb-a20c-7eeaf4b27331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e053d67-0fef-4bbf-a717-353fa6ebe639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e053d67-0fef-4bbf-a717-353fa6ebe639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b25c4c-566c-41ab-ba5b-7e39686def1b', 'volume_name': 'volume-20b25c4c-566c-41ab-ba5b-7e39686def1b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0389b408-ee31-4c1d-83bf-572fb7c3ec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0389b408-ee31-4c1d-83bf-572fb7c3ec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08ca300-7687-4922-b652-0858757b26fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:04 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Volume 20b25c4c-566c-41ab-ba5b-7e39686def1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b25c4c-566c-41ab-ba5b-7e39686def1b', 'volume_size': 1}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356701272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b25c4c-566c-41ab-ba5b-7e39686def1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbbfa4a67e104e3e9326c330643112c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:23:05Z,use_quota=True,user_id='c3682ef3356b4723a87e342f70a72203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Creating volume 20b25c4c-566c-41ab-ba5b-7e39686def1b {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:23:04 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:23:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-20b25c4c-566c-41ab-ba5b-7e39686def1b 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:04 devstack sudo[113656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-20b25c4c-566c-41ab-ba5b-7e39686def1b 1073741824
Aug 26 17:23:04 devstack sudo[113656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:05 devstack sudo[113656]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-20b25c4c-566c-41ab-ba5b-7e39686def1b 1073741824" returned: 0 in 0.403s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-20b25c4c-566c-41ab-ba5b-7e39686def1b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:05 devstack sudo[113661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-20b25c4c-566c-41ab-ba5b-7e39686def1b
Aug 26 17:23:05 devstack sudo[113661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:05 devstack sudo[113661]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-20b25c4c-566c-41ab-ba5b-7e39686def1b" returned: 0 in 0.227s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08ca300-7687-4922-b652-0858757b26fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b25c4c-566c-41ab-ba5b-7e39686def1b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51c89cb-6250-457c-bfc9-5c8dd581926f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:05 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Volume volume-20b25c4c-566c-41ab-ba5b-7e39686def1b (20b25c4c-566c-41ab-ba5b-7e39686def1b): created successfully
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51c89cb-6250-457c-bfc9-5c8dd581926f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Flow 'volume_create_manager' (104665d1-b001-49b9-b8ec-81e0ef84079c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:23:05 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-dbb798e9-215d-40f6-abee-20a0f3fbd572 tempest-ProjectReaderTests-312170268 None] Created volume successfully.
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Acquiring lock "cinder-20b25c4c-566c-41ab-ba5b-7e39686def1b-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Lock "cinder-20b25c4c-566c-41ab-ba5b-7e39686def1b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Acquiring lock "cinder-quobyte-20b25c4c-566c-41ab-ba5b-7e39686def1b" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Lock "cinder-quobyte-20b25c4c-566c-41ab-ba5b-7e39686def1b" acquired by "delete_volume" :: waited 0.012s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb83a1c-255a-47e6-8e4b-8e472195bd30]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:23:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-20b25c4c-566c-41ab-ba5b-7e39686def1b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:06 devstack sudo[113664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-20b25c4c-566c-41ab-ba5b-7e39686def1b
Aug 26 17:23:06 devstack sudo[113664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:06 devstack sudo[113664]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-20b25c4c-566c-41ab-ba5b-7e39686def1b" returned: 0 in 0.339s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-20b25c4c-566c-41ab-ba5b-7e39686def1b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:06 devstack sudo[113669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-20b25c4c-566c-41ab-ba5b-7e39686def1b
Aug 26 17:23:06 devstack sudo[113669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:06 devstack sudo[113669]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-20b25c4c-566c-41ab-ba5b-7e39686def1b" returned: 0 in 0.234s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Lock "cinder-quobyte-20b25c4c-566c-41ab-ba5b-7e39686def1b" released by "delete_volume" :: held 0.606s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Created reservations ['232a4962-11e0-451a-a4cc-390feb91a27a', '73c68bf7-9c21-4904-8f54-542c43d81bc8', '1996abad-d844-4aa5-a5b9-d2f1f2eaed8f', 'a7af5f6e-3cc0-40c0-af8b-3070b3c11d42'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:06 devstack sudo[113673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:23:06 devstack sudo[113673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:06 devstack sudo[113673]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.232s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:23:06 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Deleted volume successfully.
Aug 26 17:23:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-712b0e71-6252-41ab-b9e6-ede001bcb00a tempest-ProjectReaderTests-312170268 None] Lock "cinder-20b25c4c-566c-41ab-ba5b-7e39686def1b-delete_volume" released by "delete_volume" :: held 1.010s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:16 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=94,cinder:SELECT=76,cinder:INSERT=27,cinder:DELETE=7 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:23:16 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=62,cinder:UPDATE=107,cinder:INSERT=28,cinder:DELETE=11 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:23:33 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:23:33 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Flow 'volume_create_manager' (0a4cfcfb-1994-4391-b4d3-57b3818154e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e424989-f853-4453-8f9b-2718bc715a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e424989-f853-4453-8f9b-2718bc715a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1040156968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f795f16e-4000-4e4e-bdaf-def6ff066ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2f4b2ab3ca420ba5fcd35e9b2bd028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:23:34Z,use_quota=True,user_id='153df12343554954b7c8d532aa18ed6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecee8bf0-711e-467e-80db-4f562ff34b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecee8bf0-711e-467e-80db-4f562ff34b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116d951e-6d33-4f0a-8134-708e74c8def7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116d951e-6d33-4f0a-8134-708e74c8def7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f795f16e-4000-4e4e-bdaf-def6ff066ac1', 'volume_name': 'volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8416b005-832a-41fd-b1d4-b80505b1962f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8416b005-832a-41fd-b1d4-b80505b1962f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbb681b-d73c-421b-b2b6-278b6583a718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:34 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Volume f795f16e-4000-4e4e-bdaf-def6ff066ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1', 'volume_size': 1}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1040156968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f795f16e-4000-4e4e-bdaf-def6ff066ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2f4b2ab3ca420ba5fcd35e9b2bd028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:23:34Z,use_quota=True,user_id='153df12343554954b7c8d532aa18ed6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Creating volume f795f16e-4000-4e4e-bdaf-def6ff066ac1 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:23:34 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:34 devstack sudo[113722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 1073741824
Aug 26 17:23:34 devstack sudo[113722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:34 devstack sudo[113722]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 1073741824" returned: 0 in 0.404s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:34 devstack sudo[113727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1
Aug 26 17:23:34 devstack sudo[113727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:34 devstack sudo[113727]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1" returned: 0 in 0.242s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbb681b-d73c-421b-b2b6-278b6583a718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc20fd85-167d-4696-bf69-a1734662b642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:34 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Volume volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 (f795f16e-4000-4e4e-bdaf-def6ff066ac1): created successfully
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc20fd85-167d-4696-bf69-a1734662b642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Flow 'volume_create_manager' (0a4cfcfb-1994-4391-b4d3-57b3818154e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:23:34 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-07b914ba-caf9-4797-890f-d1a8e79fe6c6 tempest-SnapshotDependencyTests-779765221 None] Created volume successfully.
Aug 26 17:23:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] Creating offline snapshot d8c26103-cc84-4ecc-b595-b96b16cdcbb9 of volume f795f16e-4000-4e4e-bdaf-def6ff066ac1 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:23:35 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b667e6a-e047-4d23-8853-1f951e0e7407]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:23:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:35 devstack sudo[113730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1
Aug 26 17:23:35 devstack sudo[113730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:35 devstack sudo[113730]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1" returned: 0 in 0.351s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:35 devstack sudo[113736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9 1G
Aug 26 17:23:35 devstack sudo[113736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:35 devstack sudo[113736]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9 1G" returned: 0 in 0.380s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:36 devstack sudo[113741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9
Aug 26 17:23:36 devstack sudo[113741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:36 devstack sudo[113741]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9" returned: 0 in 0.312s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:36 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9 is being set with open permissions: ugo+rw
Aug 26 17:23:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:36 devstack sudo[113747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9
Aug 26 17:23:36 devstack sudo[113747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:36 devstack sudo[113747]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9" returned: 0 in 0.240s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:36 devstack sudo[113751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.info
Aug 26 17:23:36 devstack sudo[113751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:36 devstack sudo[113751]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.info" returned: 0 in 0.254s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:36 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.info is being set with open permissions: ugo+rw
Aug 26 17:23:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:36 devstack sudo[113754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.info
Aug 26 17:23:36 devstack sudo[113754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:37 devstack sudo[113754]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.info" returned: 0 in 0.247s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-34c4e6fe-a7f3-458c-a65e-4d44cfa84028 tempest-SnapshotDependencyTests-779765221 None] Create snapshot completed successfully
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Flow 'volume_create_manager' (afbcff50-ac0b-4f09-b4f1-b7d229adedd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e776d2b1-70ea-4d4f-9197-38992aa52665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e776d2b1-70ea-4d4f-9197-38992aa52665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2119b13-fb29-400c-8c23-ddc5fb4a0d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2f4b2ab3ca420ba5fcd35e9b2bd028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8c26103-cc84-4ecc-b595-b96b16cdcbb9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:23:38Z,use_quota=True,user_id='153df12343554954b7c8d532aa18ed6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ae513e-e65c-4477-bd48-2e0f1bfe12e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ae513e-e65c-4477-bd48-2e0f1bfe12e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a8bd9b-0f23-408e-853a-542ca2af2b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a8bd9b-0f23-408e-853a-542ca2af2b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd2119b13-fb29-400c-8c23-ddc5fb4a0d9c', 'volume_name': 'volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c', 'volume_size': 1, 'snapshot_id': 'd8c26103-cc84-4ecc-b595-b96b16cdcbb9'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc63a03-f3c9-4196-a3df-ebb7a0886ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc63a03-f3c9-4196-a3df-ebb7a0886ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef293ab-aeda-4480-9544-290e22dde0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:37 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Volume d2119b13-fb29-400c-8c23-ddc5fb4a0d9c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c', 'volume_size': 1, 'snapshot_id': 'd8c26103-cc84-4ecc-b595-b96b16cdcbb9'}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "cinder-quobyte-d8c26103-cc84-4ecc-b595-b96b16cdcbb9-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" by "_create_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-quobyte-d8c26103-cc84-4ecc-b595-b96b16cdcbb9-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Creating volume d2119b13-fb29-400c-8c23-ddc5fb4a0d9c from snapshot d8c26103-cc84-4ecc-b595-b96b16cdcbb9 {{(pid=94125) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "cinder-quobyte-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" by "_copy_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-quobyte-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] snapshot: d8c26103-cc84-4ecc-b595-b96b16cdcbb9, volume: d2119b13-fb29-400c-8c23-ddc5fb4a0d9c,  {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b7bf90-aa5f-41f0-8958-68176b1a3c86]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:38 devstack sudo[113757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9
Aug 26 17:23:38 devstack sudo[113757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:38 devstack sudo[113757]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9" returned: 0 in 0.346s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b33e3e1-bd08-4c84-97cf-95bf3f1525fa]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:38 devstack sudo[113762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1
Aug 26 17:23:38 devstack sudo[113762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:38 devstack sudo[113762]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1" returned: 0 in 0.349s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Creating direct copy from snapshot {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG cinder.utils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Path /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c not found in is_blk_device check {{(pid=94125) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 26 17:23:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:38 devstack sudo[113767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c
Aug 26 17:23:38 devstack sudo[113767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:42 devstack sudo[113782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:23:42 devstack sudo[113782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:42 devstack sudo[113767]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" returned: 0 in 3.938s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1, size 1024.00 MB, duration 3.94 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:23:42 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Converted 1024.00 MB image at 259.93 MB/s
Aug 26 17:23:42 devstack sudo[113782]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:42 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c is being set with open permissions: ugo+rw
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.512s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 29 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>, <Thread(Rabbit-heartbeat, started daemon 133049442341056)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:23:42 devstack sudo[113785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c
Aug 26 17:23:42 devstack sudo[113785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:42 devstack sudo[113785]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" returned: 0 in 0.232s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-quobyte-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" released by "_copy_volume_from_snapshot" :: held 4.943s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-quobyte-d8c26103-cc84-4ecc-b595-b96b16cdcbb9-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" released by "_create_volume_from_snapshot" :: held 5.007s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.022s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef293ab-aeda-4480-9544-290e22dde0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c', 'volume_size': 1, 'snapshot_id': 'd8c26103-cc84-4ecc-b595-b96b16cdcbb9'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24371233-c7b9-40ed-b3ed-a50a84ebf7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:23:43 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Volume volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c (d2119b13-fb29-400c-8c23-ddc5fb4a0d9c): created successfully
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24371233-c7b9-40ed-b3ed-a50a84ebf7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Flow 'volume_create_manager' (afbcff50-ac0b-4f09-b4f1-b7d229adedd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:23:43 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ab9207cb-43c0-4a73-968c-8b55d745937d tempest-SnapshotDependencyTests-779765221 None] Created volume successfully.
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "cinder-d8c26103-cc84-4ecc-b595-b96b16cdcbb9-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-d8c26103-cc84-4ecc-b595-b96b16cdcbb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "cinder-quobyte-f795f16e-4000-4e4e-bdaf-def6ff066ac1" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-quobyte-f795f16e-4000-4e4e-bdaf-def6ff066ac1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "cinder-quobyte-d8c26103-cc84-4ecc-b595-b96b16cdcbb9" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-quobyte-d8c26103-cc84-4ecc-b595-b96b16cdcbb9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Deleting offline snapshot d8c26103-cc84-4ecc-b595-b96b16cdcbb9 of volume f795f16e-4000-4e4e-bdaf-def6ff066ac1 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] snapshot_file for this snap is: volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45d4c0d-c69a-4450-8053-5609cf3f14d9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:43 devstack sudo[113788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9
Aug 26 17:23:43 devstack sudo[113788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:43 devstack sudo[113788]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9" returned: 0 in 0.337s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9e2bc1-fced-4ab7-a6e7-00787dc22230]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:23:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:44 devstack sudo[113793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1
Aug 26 17:23:44 devstack sudo[113793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:44 devstack sudo[113793]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1" returned: 0 in 0.523s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:44 devstack sudo[113798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9
Aug 26 17:23:44 devstack sudo[113798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:44 devstack sudo[113798]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9" returned: 0 in 0.315s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:44 devstack sudo[113804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9
Aug 26 17:23:44 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:44 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1.d8c26103-cc84-4ecc-b595-b96b16cdcbb9" returned: 0 in 0.240s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-quobyte-d8c26103-cc84-4ecc-b595-b96b16cdcbb9" released by "_delete_snapshot" :: held 1.504s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-quobyte-f795f16e-4000-4e4e-bdaf-def6ff066ac1" released by "delete_snapshot" :: held 1.525s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:45 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Created reservations ['da703969-21b8-4dbb-a79a-a5a1658f3c91', 'aab66a65-169b-4c28-8b46-1a9b2d25d3ec', 'c3390ae1-d630-46b2-993b-ad94ba34b812', '0d79d4c4-54cf-4684-88bf-2e1ce35d9479'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:23:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Delete snapshot completed successfully.
Aug 26 17:23:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0bf6c4f0-d65b-421d-a5da-8f8bbfadd03c tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-d8c26103-cc84-4ecc-b595-b96b16cdcbb9-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "cinder-f795f16e-4000-4e4e-bdaf-def6ff066ac1-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-f795f16e-4000-4e4e-bdaf-def6ff066ac1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "cinder-quobyte-f795f16e-4000-4e4e-bdaf-def6ff066ac1" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-quobyte-f795f16e-4000-4e4e-bdaf-def6ff066ac1" acquired by "delete_volume" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:45 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9a85ad-332b-4b2b-a30d-a6f4775129ed]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:23:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:45 devstack sudo[113807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1
Aug 26 17:23:45 devstack sudo[113807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:46 devstack sudo[113807]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1" returned: 0 in 0.338s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:46 devstack sudo[113812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1
Aug 26 17:23:46 devstack sudo[113812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:46 devstack sudo[113812]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f795f16e-4000-4e4e-bdaf-def6ff066ac1" returned: 0 in 0.234s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-quobyte-f795f16e-4000-4e4e-bdaf-def6ff066ac1" released by "delete_volume" :: held 0.623s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Created reservations ['7e709a38-d2c5-4400-a1ee-9df3ccf784b0', 'e7658ed9-cce8-43b3-94dc-f688ce4d63f0', 'c24d41c1-23b8-45e1-a14d-a42c052c7f2a', '088535c9-605e-463e-87dc-3880c3eaef5e'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:46 devstack sudo[113815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:23:46 devstack sudo[113815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:46 devstack sudo[113815]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.240s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:23:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Deleted volume successfully.
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-eef0ef03-0ee4-4a78-8fc6-2c476e02978f tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-f795f16e-4000-4e4e-bdaf-def6ff066ac1-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "cinder-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "cinder-quobyte-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-quobyte-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" acquired by "delete_volume" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[0942821e-9271-4f47-94c7-e94f627844c3]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:23:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:46 devstack sudo[113819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c
Aug 26 17:23:46 devstack sudo[113819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:47 devstack sudo[113819]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" returned: 0 in 0.351s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:47 devstack sudo[113824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c
Aug 26 17:23:47 devstack sudo[113824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:47 devstack sudo[113824]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" returned: 0 in 0.237s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-quobyte-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c" released by "delete_volume" :: held 0.626s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Created reservations ['fb2607ec-6d7c-43ae-99bb-a92a6964e1ba', '9520d219-422b-48dd-9d3d-b18b02b63794', '0e0b98b4-e8b0-40af-bc7a-a5cc7092f3d2', 'b2c91a6d-de5c-42de-949e-ebc93ca044be'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:23:47 devstack sudo[113827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:23:47 devstack sudo[113827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:23:47 devstack sudo[113827]: pam_unix(sudo:session): session closed for user root
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.228s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:23:47 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Deleted volume successfully.
Aug 26 17:23:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1e18b648-cdbf-45b8-814c-1d778be857ce tempest-SnapshotDependencyTests-779765221 None] Lock "cinder-d2119b13-fb29-400c-8c23-ddc5fb4a0d9c-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:23:57 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=2 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:23:57 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=27,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=3 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Flow 'volume_create_manager' (bb2a5457-66ba-42a6-9c28-b58e9811d07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543a97aa-87ff-44f3-9050-26184a44f8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543a97aa-87ff-44f3-9050-26184a44f8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317221514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fee682-56c3-4b1d-b979-946d8925c9a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ca3db26a3d4e21987349d5916c0167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:07Z,use_quota=True,user_id='2f917f7d0f9d40b6aac7155c6b7f083b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ff6eee-8d3c-4b73-9fbd-c81ec7b5eccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ff6eee-8d3c-4b73-9fbd-c81ec7b5eccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e6f351-d79b-4194-8b1e-87ea2975ec08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e6f351-d79b-4194-8b1e-87ea2975ec08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1fee682-56c3-4b1d-b979-946d8925c9a8', 'volume_name': 'volume-d1fee682-56c3-4b1d-b979-946d8925c9a8', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8130fd6-ea93-483d-bd9e-2e6d97a2c0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8130fd6-ea93-483d-bd9e-2e6d97a2c0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272ec55f-653e-405d-8434-537266f8f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume d1fee682-56c3-4b1d-b979-946d8925c9a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1fee682-56c3-4b1d-b979-946d8925c9a8', 'volume_size': 1}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317221514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fee682-56c3-4b1d-b979-946d8925c9a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ca3db26a3d4e21987349d5916c0167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:07Z,use_quota=True,user_id='2f917f7d0f9d40b6aac7155c6b7f083b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Creating volume d1fee682-56c3-4b1d-b979-946d8925c9a8 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:07 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d1fee682-56c3-4b1d-b979-946d8925c9a8 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:07 devstack sudo[113874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d1fee682-56c3-4b1d-b979-946d8925c9a8 1073741824
Aug 26 17:24:07 devstack sudo[113874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Flow 'volume_create_manager' (69e37f31-eeca-4870-99c4-6bc01bf8546b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53a8809-79be-4736-b31c-c805a124a59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53a8809-79be-4736-b31c-c805a124a59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-495972288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8554b51c-a208-4980-a698-8bc252572fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62691be564154d52b989fc87e0b5b08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:07Z,use_quota=True,user_id='1f4712f4ce7c4f9b817b5f9528b5d198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abe575b-bc16-4cab-8a58-d9ab245a95ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abe575b-bc16-4cab-8a58-d9ab245a95ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426bf048-36e1-4956-92c9-b4305e1b10ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426bf048-36e1-4956-92c9-b4305e1b10ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8554b51c-a208-4980-a698-8bc252572fcb', 'volume_name': 'volume-8554b51c-a208-4980-a698-8bc252572fcb', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97156e3b-1fd1-4e83-adf7-5ebdc907bc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97156e3b-1fd1-4e83-adf7-5ebdc907bc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc0a8af-eefa-47b5-bd25-3fc910d6205f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Volume 8554b51c-a208-4980-a698-8bc252572fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8554b51c-a208-4980-a698-8bc252572fcb', 'volume_size': 1}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Flow 'volume_create_manager' (32734b1d-ddba-4195-af69-0986c12136c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1202c5a7-74f1-4e56-ba5a-282de24a4d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1202c5a7-74f1-4e56-ba5a-282de24a4d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-806731335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec539d0de624c71b439a325003c4214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:08Z,use_quota=True,user_id='dca85619231b412faddf53c2badd8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717873d3-251c-4a52-8b95-a5c3502bfe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717873d3-251c-4a52-8b95-a5c3502bfe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0619d4cd-3b05-46ba-b359-c3543ab73439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0619d4cd-3b05-46ba-b359-c3543ab73439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74', 'volume_name': 'volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c790a0db-027d-4876-b750-94f83f8a9ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:07 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c790a0db-027d-4876-b750-94f83f8a9ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18336251-6a1a-4972-9c15-5f35c111faa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:08 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Volume 3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74', 'volume_size': 1}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:08 devstack sudo[113874]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d1fee682-56c3-4b1d-b979-946d8925c9a8 1073741824" returned: 0 in 0.653s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d1fee682-56c3-4b1d-b979-946d8925c9a8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:08 devstack sudo[113880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d1fee682-56c3-4b1d-b979-946d8925c9a8
Aug 26 17:24:08 devstack sudo[113880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Flow 'volume_create_manager' (2e3a9c73-78e1-4d18-88d1-b419080bb8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdc6284-35b3-41fb-9651-393a6d8d214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdc6284-35b3-41fb-9651-393a6d8d214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-881771768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1635a3d0-4793-4c9d-b718-349661a05b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec539d0de624c71b439a325003c4214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:08Z,use_quota=True,user_id='dca85619231b412faddf53c2badd8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b93b262-00f3-4966-83be-45ff9f81bddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b93b262-00f3-4966-83be-45ff9f81bddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb071d5-c8d9-4993-bd72-e2c19118fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb071d5-c8d9-4993-bd72-e2c19118fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1635a3d0-4793-4c9d-b718-349661a05b5e', 'volume_name': 'volume-1635a3d0-4793-4c9d-b718-349661a05b5e', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a646b89-4954-4be1-ba56-d1ce1538f743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a646b89-4954-4be1-ba56-d1ce1538f743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a49c8f-d94b-4fbc-bc84-e57c6f6796b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:08 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Volume 1635a3d0-4793-4c9d-b718-349661a05b5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1635a3d0-4793-4c9d-b718-349661a05b5e', 'volume_size': 1}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:08 devstack sudo[113880]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d1fee682-56c3-4b1d-b979-946d8925c9a8" returned: 0 in 0.384s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-495972288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8554b51c-a208-4980-a698-8bc252572fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62691be564154d52b989fc87e0b5b08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:07Z,use_quota=True,user_id='1f4712f4ce7c4f9b817b5f9528b5d198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Creating volume 8554b51c-a208-4980-a698-8bc252572fcb {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:08 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272ec55f-653e-405d-8434-537266f8f935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1fee682-56c3-4b1d-b979-946d8925c9a8', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:08 devstack sudo[113883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb 1073741824
Aug 26 17:24:08 devstack sudo[113883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d417f438-141b-4b39-85a9-d8a101ee6814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:08 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume volume-d1fee682-56c3-4b1d-b979-946d8925c9a8 (d1fee682-56c3-4b1d-b979-946d8925c9a8): created successfully
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d417f438-141b-4b39-85a9-d8a101ee6814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Flow 'volume_create_manager' (bb2a5457-66ba-42a6-9c28-b58e9811d07c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:08 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-95adf0ad-0289-4e35-9bab-c7cb43122236 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Created volume successfully.
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Flow 'volume_create_manager' (a71f3979-eee2-4c4a-ba03-77650ab4362a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd39b56a-0b69-4f8a-8c43-1bd4a770a62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd39b56a-0b69-4f8a-8c43-1bd4a770a62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-168986423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918a48e1-36d2-4811-8e5a-157cc2c43f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec539d0de624c71b439a325003c4214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:09Z,use_quota=True,user_id='dca85619231b412faddf53c2badd8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cce3f7-5b5f-4ce1-93ee-2cfa2d1ade08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cce3f7-5b5f-4ce1-93ee-2cfa2d1ade08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b5b2af-b68c-434f-a296-235e42085065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b5b2af-b68c-434f-a296-235e42085065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918a48e1-36d2-4811-8e5a-157cc2c43f0a', 'volume_name': 'volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0df3ec0-04f8-4be9-9f6e-4d719686c144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0df3ec0-04f8-4be9-9f6e-4d719686c144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7462c4-70e9-40de-9a33-2bf4821e81f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:08 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Volume 918a48e1-36d2-4811-8e5a-157cc2c43f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a', 'volume_size': 1}
Aug 26 17:24:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:09 devstack sudo[113883]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb 1073741824" returned: 0 in 0.640s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:09 devstack sudo[113889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb
Aug 26 17:24:09 devstack sudo[113889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Flow 'volume_create_manager' (e5d28abc-0764-4fb3-8b4d-5fb7e826983d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f045859-601c-48e2-8e27-878f1e380ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f045859-601c-48e2-8e27-878f1e380ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-686462227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418ac279-e949-4e47-b74a-fbbfc2dd9489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec539d0de624c71b439a325003c4214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:09Z,use_quota=True,user_id='dca85619231b412faddf53c2badd8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea356e36-3bb6-4415-8829-6525dd161f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea356e36-3bb6-4415-8829-6525dd161f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d70d66-3096-4986-ad40-ccfcb0b4c019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d70d66-3096-4986-ad40-ccfcb0b4c019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '418ac279-e949-4e47-b74a-fbbfc2dd9489', 'volume_name': 'volume-418ac279-e949-4e47-b74a-fbbfc2dd9489', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2f224b-e07a-4520-b11e-17a7eb25d587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2f224b-e07a-4520-b11e-17a7eb25d587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d01da0f-9fed-4f5f-b3ca-7abdcb60515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:09 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Volume 418ac279-e949-4e47-b74a-fbbfc2dd9489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-418ac279-e949-4e47-b74a-fbbfc2dd9489', 'volume_size': 1}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:09 devstack sudo[113889]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb" returned: 0 in 0.438s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.647s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-806731335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec539d0de624c71b439a325003c4214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:08Z,use_quota=True,user_id='dca85619231b412faddf53c2badd8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Creating volume 3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:09 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:09 devstack sudo[113892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74 1073741824
Aug 26 17:24:09 devstack sudo[113892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc0a8af-eefa-47b5-bd25-3fc910d6205f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8554b51c-a208-4980-a698-8bc252572fcb', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66f79bd-2eb9-44fe-b6f0-1a88c73624e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:09 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Volume volume-8554b51c-a208-4980-a698-8bc252572fcb (8554b51c-a208-4980-a698-8bc252572fcb): created successfully
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66f79bd-2eb9-44fe-b6f0-1a88c73624e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Flow 'volume_create_manager' (69e37f31-eeca-4870-99c4-6bc01bf8546b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Flow 'volume_create_manager' (380befdf-c1e8-423f-8444-1b074d79b75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cde0f34-107e-4658-bfe7-1ecfa5af223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:09 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-78f5d950-ee1a-4d08-a5b3-2bbf451fe1f2 tempest-VolumeDependencyTests-348588549 None] Created volume successfully.
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cde0f34-107e-4658-bfe7-1ecfa5af223d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1452946161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda35175-d0f5-4b36-949c-8c6324462a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec539d0de624c71b439a325003c4214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:10Z,use_quota=True,user_id='dca85619231b412faddf53c2badd8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d83aaee-6eaf-4dda-b22a-8ba80404be49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d83aaee-6eaf-4dda-b22a-8ba80404be49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ceed3a-c2f8-4055-9de5-4b7a9dcc9812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ceed3a-c2f8-4055-9de5-4b7a9dcc9812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda35175-d0f5-4b36-949c-8c6324462a9d', 'volume_name': 'volume-cda35175-d0f5-4b36-949c-8c6324462a9d', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486ebea0-2bd1-4bfd-873c-bb356e2bf0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486ebea0-2bd1-4bfd-873c-bb356e2bf0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f8d91f-6055-42e3-9f84-3569c9445f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:09 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Volume cda35175-d0f5-4b36-949c-8c6324462a9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda35175-d0f5-4b36-949c-8c6324462a9d', 'volume_size': 1}
Aug 26 17:24:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:10 devstack sudo[113892]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Flow 'volume_create_manager' (13fd185d-e1fe-468f-ae57-6ae99c32902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff30bd1-f908-4efe-9e96-cf2f616f7e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74 1073741824" returned: 0 in 0.621s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff30bd1-f908-4efe-9e96-cf2f616f7e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1634825029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeabca87-2ac6-4372-900f-81337284bf9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ca3db26a3d4e21987349d5916c0167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:10Z,use_quota=True,user_id='2f917f7d0f9d40b6aac7155c6b7f083b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254be58a-9174-43f8-ab27-d5e03978b24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254be58a-9174-43f8-ab27-d5e03978b24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d033942-5bee-4812-a201-b171fae99d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d033942-5bee-4812-a201-b171fae99d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeabca87-2ac6-4372-900f-81337284bf9c', 'volume_name': 'volume-eeabca87-2ac6-4372-900f-81337284bf9c', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c69b4e9-a2f1-4490-ab2e-63f04dda5da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c69b4e9-a2f1-4490-ab2e-63f04dda5da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9453527a-fa19-4323-8901-351380b57ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:10 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume eeabca87-2ac6-4372-900f-81337284bf9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeabca87-2ac6-4372-900f-81337284bf9c', 'volume_size': 1}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:10 devstack sudo[113898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74
Aug 26 17:24:10 devstack sudo[113898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:10 devstack sudo[113898]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74" returned: 0 in 0.318s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.258s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-881771768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1635a3d0-4793-4c9d-b718-349661a05b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec539d0de624c71b439a325003c4214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:08Z,use_quota=True,user_id='dca85619231b412faddf53c2badd8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Creating volume 1635a3d0-4793-4c9d-b718-349661a05b5e {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:10 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1635a3d0-4793-4c9d-b718-349661a05b5e 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:10 devstack sudo[113901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1635a3d0-4793-4c9d-b718-349661a05b5e 1073741824
Aug 26 17:24:10 devstack sudo[113901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Flow 'volume_create_manager' (1d740781-df09-44a5-8464-cc120b4da88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284b0ea2-2b8d-44a4-a9c6-e1426dcc1c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18336251-6a1a-4972-9c15-5f35c111faa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083b9941-3340-4be3-ab84-f84de6d6e49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284b0ea2-2b8d-44a4-a9c6-e1426dcc1c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631155910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3eaeb63-8f77-48ef-b18d-45edb74183d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ca3db26a3d4e21987349d5916c0167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:11Z,use_quota=True,user_id='2f917f7d0f9d40b6aac7155c6b7f083b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c81fb0-3322-4f52-ab44-b8264c01eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c81fb0-3322-4f52-ab44-b8264c01eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7367e93-543b-4f44-b140-a6acce2b49b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7367e93-543b-4f44-b140-a6acce2b49b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3eaeb63-8f77-48ef-b18d-45edb74183d3', 'volume_name': 'volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25db9d95-125f-463a-94c0-380156a905cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25db9d95-125f-463a-94c0-380156a905cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f28bdf-4334-4918-a75d-b8f16491b780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:10 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume f3eaeb63-8f77-48ef-b18d-45edb74183d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3', 'volume_size': 1}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:10 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Volume volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74 (3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74): created successfully
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083b9941-3340-4be3-ab84-f84de6d6e49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Flow 'volume_create_manager' (32734b1d-ddba-4195-af69-0986c12136c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:10 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-94ddf07c-0a06-42ec-b087-0df8170f50c8 tempest-CreateVolumesFromImageTest-856054990 None] Created volume successfully.
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:11 devstack sudo[113901]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1635a3d0-4793-4c9d-b718-349661a05b5e 1073741824" returned: 0 in 0.715s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Flow 'volume_create_manager' (6640ee65-cb3b-437f-8944-fd2df459d419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c696e8-8bbc-470a-9df4-7397dcc1ed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c696e8-8bbc-470a-9df4-7397dcc1ed9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-409079232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b08365-c5bb-4cb7-9002-5054648fd35b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ca3db26a3d4e21987349d5916c0167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:11Z,use_quota=True,user_id='2f917f7d0f9d40b6aac7155c6b7f083b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8488adf-cba6-466b-8e15-7d385ebb140b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8488adf-cba6-466b-8e15-7d385ebb140b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6eb111-b2da-4da4-a535-99084ceee5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6eb111-b2da-4da4-a535-99084ceee5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b08365-c5bb-4cb7-9002-5054648fd35b', 'volume_name': 'volume-62b08365-c5bb-4cb7-9002-5054648fd35b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e81def-7e71-4ff4-b5f0-9582a46b1cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e81def-7e71-4ff4-b5f0-9582a46b1cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e2a308-0935-4baa-bcc4-29e2c26915a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:11 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume 62b08365-c5bb-4cb7-9002-5054648fd35b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b08365-c5bb-4cb7-9002-5054648fd35b', 'volume_size': 1}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1635a3d0-4793-4c9d-b718-349661a05b5e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:11 devstack sudo[113907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1635a3d0-4793-4c9d-b718-349661a05b5e
Aug 26 17:24:11 devstack sudo[113907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Flow 'volume_create_manager' (82d6fca2-d281-4567-a2fc-f5e5cec9db68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae6debd-45f3-43e9-ab52-3787963709f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae6debd-45f3-43e9-ab52-3787963709f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361445941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ca3db26a3d4e21987349d5916c0167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:12Z,use_quota=True,user_id='2f917f7d0f9d40b6aac7155c6b7f083b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef875bd-1133-42a4-ae3e-e12b2b354d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef875bd-1133-42a4-ae3e-e12b2b354d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ff112f-f078-419e-979e-ec2225405109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ff112f-f078-419e-979e-ec2225405109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8', 'volume_name': 'volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50111e9c-6aea-43ca-b5cf-4609ec7aef03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50111e9c-6aea-43ca-b5cf-4609ec7aef03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62fa386-fb1d-4699-9f27-65978bcbc965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:11 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8', 'volume_size': 1}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:11 devstack sudo[113907]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1635a3d0-4793-4c9d-b718-349661a05b5e" returned: 0 in 0.336s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.985s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-168986423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918a48e1-36d2-4811-8e5a-157cc2c43f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec539d0de624c71b439a325003c4214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:09Z,use_quota=True,user_id='dca85619231b412faddf53c2badd8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Creating volume 918a48e1-36d2-4811-8e5a-157cc2c43f0a {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:11 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a49c8f-d94b-4fbc-bc84-e57c6f6796b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1635a3d0-4793-4c9d-b718-349661a05b5e', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19d5416-5836-4d07-bd5f-062f8b44729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:11 devstack sudo[113910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a 1073741824
Aug 26 17:24:11 devstack sudo[113910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Volume volume-1635a3d0-4793-4c9d-b718-349661a05b5e (1635a3d0-4793-4c9d-b718-349661a05b5e): created successfully
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19d5416-5836-4d07-bd5f-062f8b44729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Flow 'volume_create_manager' (2e3a9c73-78e1-4d18-88d1-b419080bb8e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:12 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-352ef2a2-7e52-4692-be43-cdfc2a7cb2fd tempest-CreateVolumesFromImageTest-856054990 None] Created volume successfully.
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Flow 'volume_create_manager' (992fcd18-5e10-4566-b53c-b3740bf0c484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1673b1a8-1ede-4adf-8232-b19f743f0158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1673b1a8-1ede-4adf-8232-b19f743f0158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-309308272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70ba02b-683b-47a1-b428-4ea704acc335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ca3db26a3d4e21987349d5916c0167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:12Z,use_quota=True,user_id='2f917f7d0f9d40b6aac7155c6b7f083b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ff8a90-1a25-4816-8189-8c311e7075bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ff8a90-1a25-4816-8189-8c311e7075bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fcf664-1d77-491f-94e0-7baa9e9476c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fcf664-1d77-491f-94e0-7baa9e9476c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70ba02b-683b-47a1-b428-4ea704acc335', 'volume_name': 'volume-c70ba02b-683b-47a1-b428-4ea704acc335', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6cae86-292b-4be8-a27a-13f60843cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6cae86-292b-4be8-a27a-13f60843cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10488d2-7ccb-491b-85e8-ca775ce6b6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume c70ba02b-683b-47a1-b428-4ea704acc335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70ba02b-683b-47a1-b428-4ea704acc335', 'volume_size': 1}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Flow 'volume_create_manager' (84704c8b-d3d5-4af6-8a7e-9e136bdfb726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ea9a22-3d6a-4cb2-9400-671689f4bd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ea9a22-3d6a-4cb2-9400-671689f4bd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16813727-9e42-4029-8fc9-57ea1391cd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9b9f0a554934e06a3acc0c70a5b7ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:12Z,use_quota=True,user_id='f228445c914d43b1b8cf1f5f5dfad5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e95c9c02-2584-4046-88c1-722b957a41b0),volume_type_id=e95c9c02-2584-4046-88c1-722b957a41b0)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3873b3-4730-4fc4-b8ae-ab5a6a58fa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3873b3-4730-4fc4-b8ae-ab5a6a58fa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ae8f93-e8c4-4795-b145-dcd742ec77f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.image.glance [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Creating Keystone auth plugin from conf {{(pid=94125) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 17:24:12 devstack sudo[113910]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a 1073741824" returned: 0 in 0.496s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:12 devstack sudo[113915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a
Aug 26 17:24:12 devstack sudo[113915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ae8f93-e8c4-4795-b145-dcd742ec77f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '16813727-9e42-4029-8fc9-57ea1391cd5c', 'volume_name': 'volume-16813727-9e42-4029-8fc9-57ea1391cd5c', 'volume_size': 1, 'image_id': 'eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2f54da357dff8b6e0e25418c3af63bd7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9b9f0a554934e06a3acc0c70a5b7ba7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '465f4b8f77a5679efa0e2dffa717a428531767334bb7481e259346d2aaa3cedb94c172604092ac6e4243f013d15494fe6cb7b8178a4f658d7b7b8a37387f0070', 'id': 'eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'created_at': datetime.datetime(2026, 8, 26, 15, 24, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 24, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eab8714d-2d69-4cbd-90d9-e4363801a5d7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd1eee10>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482f4fb6-1f9e-4854-9f59-ca7c7b002027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482f4fb6-1f9e-4854-9f59-ca7c7b002027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0d1a0b-1b9f-4b5e-b3c0-c793de2161e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Volume 16813727-9e42-4029-8fc9-57ea1391cd5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-16813727-9e42-4029-8fc9-57ea1391cd5c', 'volume_size': 1, 'image_id': 'eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2f54da357dff8b6e0e25418c3af63bd7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9b9f0a554934e06a3acc0c70a5b7ba7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '465f4b8f77a5679efa0e2dffa717a428531767334bb7481e259346d2aaa3cedb94c172604092ac6e4243f013d15494fe6cb7b8178a4f658d7b7b8a37387f0070', 'id': 'eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'created_at': datetime.datetime(2026, 8, 26, 15, 24, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 24, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eab8714d-2d69-4cbd-90d9-e4363801a5d7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd1eee10>}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Trying to clone 16813727-9e42-4029-8fc9-57ea1391cd5c from image eab8714d-2d69-4cbd-90d9-e4363801a5d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'metadata': {}}]). {{(pid=94125) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 17:24:12 devstack sudo[113915]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a" returned: 0 in 0.280s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.419s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-686462227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418ac279-e949-4e47-b74a-fbbfc2dd9489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec539d0de624c71b439a325003c4214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:09Z,use_quota=True,user_id='dca85619231b412faddf53c2badd8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Creating volume 418ac279-e949-4e47-b74a-fbbfc2dd9489 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:12 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-418ac279-e949-4e47-b74a-fbbfc2dd9489 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7462c4-70e9-40de-9a33-2bf4821e81f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:12 devstack sudo[113918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-418ac279-e949-4e47-b74a-fbbfc2dd9489 1073741824
Aug 26 17:24:12 devstack sudo[113918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cf7905-6f03-4d2c-ae6b-2c583e62cad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Volume volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a (918a48e1-36d2-4811-8e5a-157cc2c43f0a): created successfully
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cf7905-6f03-4d2c-ae6b-2c583e62cad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Flow 'volume_create_manager' (a71f3979-eee2-4c4a-ba03-77650ab4362a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 17:24:12 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Image download 0.00 MB at 0.00 MB/s
Aug 26 17:24:12 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-626530c8-441e-48cf-b070-44ca47a13b2e tempest-CreateVolumesFromImageTest-856054990 None] Created volume successfully.
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[15511d7e-2e9a-4a1f-987d-bc3dbaa0cba1]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:13 devstack sudo[113920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD
Aug 26 17:24:13 devstack sudo[113920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:13 devstack sudo[113920]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:13 devstack sudo[113918]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-418ac279-e949-4e47-b74a-fbbfc2dd9489 1073741824" returned: 0 in 0.520s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-418ac279-e949-4e47-b74a-fbbfc2dd9489 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:13 devstack sudo[113929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-418ac279-e949-4e47-b74a-fbbfc2dd9489
Aug 26 17:24:13 devstack sudo[113929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:13 devstack sudo[113928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD
Aug 26 17:24:13 devstack sudo[113928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:13 devstack sudo[113929]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-418ac279-e949-4e47-b74a-fbbfc2dd9489" returned: 0 in 0.253s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.673s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1452946161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda35175-d0f5-4b36-949c-8c6324462a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec539d0de624c71b439a325003c4214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:10Z,use_quota=True,user_id='dca85619231b412faddf53c2badd8f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Creating volume cda35175-d0f5-4b36-949c-8c6324462a9d {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:13 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cda35175-d0f5-4b36-949c-8c6324462a9d 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:13 devstack sudo[113928]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD" returned: 1 in 0.358s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Temporary image eab8714d-2d69-4cbd-90d9-e4363801a5d7 is fetched for user f228445c914d43b1b8cf1f5f5dfad5f4. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 17:24:13 devstack sudo[113936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cda35175-d0f5-4b36-949c-8c6324462a9d 1073741824
Aug 26 17:24:13 devstack sudo[113936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d01da0f-9fed-4f5f-b3ca-7abdcb60515d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-418ac279-e949-4e47-b74a-fbbfc2dd9489', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44ef6d2-8610-4e4c-a1e5-0f72196069e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:13 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Volume volume-418ac279-e949-4e47-b74a-fbbfc2dd9489 (418ac279-e949-4e47-b74a-fbbfc2dd9489): created successfully
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44ef6d2-8610-4e4c-a1e5-0f72196069e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Flow 'volume_create_manager' (e5d28abc-0764-4fb3-8b4d-5fb7e826983d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:13 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5530ee9a-d9bb-4453-aeb8-4285585dab11 tempest-CreateVolumesFromImageTest-856054990 None] Created volume successfully.
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c29184-4b2a-464c-84ee-a303ab5a4c63]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:13 devstack sudo[113938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD
Aug 26 17:24:13 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:14 devstack sudo[113936]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:14 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cda35175-d0f5-4b36-949c-8c6324462a9d 1073741824" returned: 0 in 0.455s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cda35175-d0f5-4b36-949c-8c6324462a9d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:14 devstack sudo[113946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cda35175-d0f5-4b36-949c-8c6324462a9d
Aug 26 17:24:14 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:14 devstack sudo[113945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD
Aug 26 17:24:14 devstack sudo[113945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:14 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cda35175-d0f5-4b36-949c-8c6324462a9d" returned: 0 in 0.271s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.050s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1634825029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeabca87-2ac6-4372-900f-81337284bf9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ca3db26a3d4e21987349d5916c0167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:10Z,use_quota=True,user_id='2f917f7d0f9d40b6aac7155c6b7f083b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Creating volume eeabca87-2ac6-4372-900f-81337284bf9c {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:14 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eeabca87-2ac6-4372-900f-81337284bf9c 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:14 devstack sudo[113953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eeabca87-2ac6-4372-900f-81337284bf9c 1073741824
Aug 26 17:24:14 devstack sudo[113953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f8d91f-6055-42e3-9f84-3569c9445f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda35175-d0f5-4b36-949c-8c6324462a9d', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:14 devstack sudo[113945]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a277eb-f1ac-4a7d-a91a-fa3e15b2d637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD" returned: 1 in 0.387s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:14 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Volume volume-cda35175-d0f5-4b36-949c-8c6324462a9d (cda35175-d0f5-4b36-949c-8c6324462a9d): created successfully
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a277eb-f1ac-4a7d-a91a-fa3e15b2d637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Flow 'volume_create_manager' (380befdf-c1e8-423f-8444-1b074d79b75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:14 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c897d03a-b48d-4184-8145-e509a92670bf tempest-CreateVolumesFromImageTest-856054990 None] Created volume successfully.
Aug 26 17:24:14 devstack sudo[113953]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eeabca87-2ac6-4372-900f-81337284bf9c 1073741824" returned: 0 in 0.428s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eeabca87-2ac6-4372-900f-81337284bf9c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:14 devstack sudo[113958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eeabca87-2ac6-4372-900f-81337284bf9c
Aug 26 17:24:14 devstack sudo[113958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:15 devstack sudo[113958]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eeabca87-2ac6-4372-900f-81337284bf9c" returned: 0 in 0.244s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.265s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631155910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3eaeb63-8f77-48ef-b18d-45edb74183d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ca3db26a3d4e21987349d5916c0167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:11Z,use_quota=True,user_id='2f917f7d0f9d40b6aac7155c6b7f083b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Creating volume f3eaeb63-8f77-48ef-b18d-45edb74183d3 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:15 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9453527a-fa19-4323-8901-351380b57ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeabca87-2ac6-4372-900f-81337284bf9c', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54da753e-6f19-449c-94f5-4642ff493e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:15 devstack sudo[113961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3 1073741824
Aug 26 17:24:15 devstack sudo[113961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:15 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume volume-eeabca87-2ac6-4372-900f-81337284bf9c (eeabca87-2ac6-4372-900f-81337284bf9c): created successfully
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54da753e-6f19-449c-94f5-4642ff493e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Flow 'volume_create_manager' (13fd185d-e1fe-468f-ae57-6ae99c32902a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:15 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4c4ddc25-82cd-4606-a1ba-016cbe9aa9c7 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Created volume successfully.
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "cinder-cda35175-d0f5-4b36-949c-8c6324462a9d-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-cda35175-d0f5-4b36-949c-8c6324462a9d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "cinder-quobyte-cda35175-d0f5-4b36-949c-8c6324462a9d" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-quobyte-cda35175-d0f5-4b36-949c-8c6324462a9d" acquired by "delete_volume" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[027c3211-c076-4560-81e7-0b425db4c7bd]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cda35175-d0f5-4b36-949c-8c6324462a9d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:15 devstack sudo[113961]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3 1073741824" returned: 0 in 0.491s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:15 devstack sudo[113968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3
Aug 26 17:24:15 devstack sudo[113968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:15 devstack sudo[113967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cda35175-d0f5-4b36-949c-8c6324462a9d
Aug 26 17:24:15 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:15 devstack sudo[113968]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3" returned: 0 in 0.241s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.506s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f28bdf-4334-4918-a75d-b8f16491b780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acd55e5-4df3-4431-83a9-147d2e926b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] Creating offline snapshot 52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 of volume 8554b51c-a208-4980-a698-8bc252572fcb {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:24:15 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cda35175-d0f5-4b36-949c-8c6324462a9d" returned: 0 in 0.362s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cda35175-d0f5-4b36-949c-8c6324462a9d {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[095626b8-19e3-4041-9eaf-51125a9d7044]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:15 devstack sudo[113975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cda35175-d0f5-4b36-949c-8c6324462a9d
Aug 26 17:24:15 devstack sudo[113975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:15 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3 (f3eaeb63-8f77-48ef-b18d-45edb74183d3): created successfully
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acd55e5-4df3-4431-83a9-147d2e926b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Flow 'volume_create_manager' (1d740781-df09-44a5-8464-cc120b4da88a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:15 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c00c0968-74bf-4dcf-a835-cc2d1fa393af tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Created volume successfully.
Aug 26 17:24:16 devstack sudo[113976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb
Aug 26 17:24:16 devstack sudo[113976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:16 devstack sudo[113975]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-cda35175-d0f5-4b36-949c-8c6324462a9d" returned: 0 in 0.260s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-quobyte-cda35175-d0f5-4b36-949c-8c6324462a9d" released by "delete_volume" :: held 0.667s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Created reservations ['ebc31e75-3bc8-4598-afbe-a633dd5fdade', '1e60886b-e57e-4787-a314-6e30551b4f68', 'c0521cce-2b8f-411e-8608-c7f667594410', '954cd37a-8ef7-415b-8c97-67476e87a145'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:16 devstack sudo[113976]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb" returned: 0 in 0.428s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:16 devstack sudo[113983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:16 devstack sudo[113983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:16 devstack sudo[113984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 1G
Aug 26 17:24:16 devstack sudo[113984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:16 devstack sudo[113983]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.251s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:16 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Deleted volume successfully.
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-39017eca-030f-44b5-a808-9c9800f321e1 tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-cda35175-d0f5-4b36-949c-8c6324462a9d-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "cinder-418ac279-e949-4e47-b74a-fbbfc2dd9489-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-418ac279-e949-4e47-b74a-fbbfc2dd9489-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "cinder-quobyte-418ac279-e949-4e47-b74a-fbbfc2dd9489" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-quobyte-418ac279-e949-4e47-b74a-fbbfc2dd9489" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aee58a1-ccd2-4d11-a751-67c700f30cab]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-418ac279-e949-4e47-b74a-fbbfc2dd9489 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:16 devstack sudo[113984]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 1G" returned: 0 in 0.452s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8554b51c-a208-4980-a698-8bc252572fcb -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:16 devstack sudo[113994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8554b51c-a208-4980-a698-8bc252572fcb -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72
Aug 26 17:24:16 devstack sudo[113994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:16 devstack sudo[113992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-418ac279-e949-4e47-b74a-fbbfc2dd9489
Aug 26 17:24:16 devstack sudo[113992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:17 devstack sudo[113992]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:17 devstack sudo[113994]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-418ac279-e949-4e47-b74a-fbbfc2dd9489" returned: 0 in 0.370s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-418ac279-e949-4e47-b74a-fbbfc2dd9489 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8554b51c-a208-4980-a698-8bc252572fcb -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72" returned: 0 in 0.301s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:17 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 is being set with open permissions: ugo+rw
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:17 devstack sudo[114003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-418ac279-e949-4e47-b74a-fbbfc2dd9489
Aug 26 17:24:17 devstack sudo[114003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:17 devstack sudo[114004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72
Aug 26 17:24:17 devstack sudo[114004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:17 devstack sudo[114003]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-418ac279-e949-4e47-b74a-fbbfc2dd9489" returned: 0 in 0.245s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-quobyte-418ac279-e949-4e47-b74a-fbbfc2dd9489" released by "delete_volume" :: held 0.664s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:17 devstack sudo[114004]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72" returned: 0 in 0.283s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Created reservations ['dbd668ad-0245-4b48-9cfe-ff762ebcd5d5', '83f8e8f1-9581-4849-b2c9-679694443599', 'a9c3c28b-5b4d-45ff-ae44-e1b04b46428d', 'fe521a7a-dc1b-4dc5-88c0-ea50941954b8'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:17 devstack sudo[114009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.info
Aug 26 17:24:17 devstack sudo[114009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:17 devstack sudo[114011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:17 devstack sudo[114011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:17 devstack sudo[114009]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.info" returned: 0 in 0.260s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:17 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.info is being set with open permissions: ugo+rw
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:17 devstack sudo[114014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.info
Aug 26 17:24:17 devstack sudo[114014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:17 devstack sudo[114011]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.254s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:17 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Deleted volume successfully.
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "cinder-918a48e1-36d2-4811-8e5a-157cc2c43f0a-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-88870fc6-2b3c-47cf-ae0d-5276c9b8c46a tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-418ac279-e949-4e47-b74a-fbbfc2dd9489-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-918a48e1-36d2-4811-8e5a-157cc2c43f0a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "cinder-quobyte-918a48e1-36d2-4811-8e5a-157cc2c43f0a" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-quobyte-918a48e1-36d2-4811-8e5a-157cc2c43f0a" acquired by "delete_volume" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c28baa8-82dd-4f3b-ad42-7fb6ab5ae9d0]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:17 devstack sudo[114014]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.info" returned: 0 in 0.268s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.443s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-409079232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b08365-c5bb-4cb7-9002-5054648fd35b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ca3db26a3d4e21987349d5916c0167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:11Z,use_quota=True,user_id='2f917f7d0f9d40b6aac7155c6b7f083b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Creating volume 62b08365-c5bb-4cb7-9002-5054648fd35b {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:18 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62b08365-c5bb-4cb7-9002-5054648fd35b 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:18 devstack sudo[114019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62b08365-c5bb-4cb7-9002-5054648fd35b 1073741824
Aug 26 17:24:18 devstack sudo[114019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:18 devstack sudo[114017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a
Aug 26 17:24:18 devstack sudo[114017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:18 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a00de7bc-950a-4831-820b-105b190ace71 tempest-VolumeDependencyTests-348588549 None] Create snapshot completed successfully
Aug 26 17:24:18 devstack sudo[114017]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a" returned: 0 in 0.374s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:18 devstack sudo[114028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a
Aug 26 17:24:18 devstack sudo[114028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:18 devstack sudo[114019]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62b08365-c5bb-4cb7-9002-5054648fd35b 1073741824" returned: 0 in 0.506s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62b08365-c5bb-4cb7-9002-5054648fd35b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:18 devstack sudo[114032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62b08365-c5bb-4cb7-9002-5054648fd35b
Aug 26 17:24:18 devstack sudo[114032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:18 devstack sudo[114028]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-918a48e1-36d2-4811-8e5a-157cc2c43f0a" returned: 0 in 0.304s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-quobyte-918a48e1-36d2-4811-8e5a-157cc2c43f0a" released by "delete_volume" :: held 0.721s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Created reservations ['bd0d1bf8-fe7c-4f04-8e85-c7fb68bce61d', '6319052d-b5bd-4a0c-a1af-eba59f12e322', '044afb21-4a9f-45d3-9bdd-7c680de2a606', '19f5282e-862c-4672-bff4-55398bee0a40'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:18 devstack sudo[114034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:18 devstack sudo[114034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:18 devstack sudo[114032]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62b08365-c5bb-4cb7-9002-5054648fd35b" returned: 0 in 0.319s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.118s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361445941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ca3db26a3d4e21987349d5916c0167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:12Z,use_quota=True,user_id='2f917f7d0f9d40b6aac7155c6b7f083b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Creating volume e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:18 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e2a308-0935-4baa-bcc4-29e2c26915a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b08365-c5bb-4cb7-9002-5054648fd35b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:18 devstack sudo[114037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8 1073741824
Aug 26 17:24:18 devstack sudo[114037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05178a0a-050e-4ec1-816b-d279a484f17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:18 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume volume-62b08365-c5bb-4cb7-9002-5054648fd35b (62b08365-c5bb-4cb7-9002-5054648fd35b): created successfully
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05178a0a-050e-4ec1-816b-d279a484f17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:18 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Flow 'volume_create_manager' (6640ee65-cb3b-437f-8944-fd2df459d419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4108fab9-bd41-4a4b-bfc8-6233d5337914 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Created volume successfully.
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "cinder-1635a3d0-4793-4c9d-b718-349661a05b5e-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Flow 'volume_create_manager' (6f4a5f5a-2cb0-42b3-943a-0c864eb47ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee6f067-be42-4b6f-bc7d-b2b091bd7733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-1635a3d0-4793-4c9d-b718-349661a05b5e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee6f067-be42-4b6f-bc7d-b2b091bd7733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1766667514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8617c32e-2712-4b8d-a19d-89bf7ab64bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62691be564154d52b989fc87e0b5b08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52aece7d-59b4-4c0c-8b2b-97a3bb29ac72,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:19Z,use_quota=True,user_id='1f4712f4ce7c4f9b817b5f9528b5d198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82e705f-6cc4-424a-bbf5-adc4e8f72746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82e705f-6cc4-424a-bbf5-adc4e8f72746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59de40ab-a76a-4c88-9869-6acef3b6f506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59de40ab-a76a-4c88-9869-6acef3b6f506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8617c32e-2712-4b8d-a19d-89bf7ab64bf6', 'volume_name': 'volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6', 'volume_size': 1, 'snapshot_id': '52aece7d-59b4-4c0c-8b2b-97a3bb29ac72'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5b0560-2f45-485d-bcb7-68564a937c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5b0560-2f45-485d-bcb7-68564a937c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:19 devstack sudo[114034]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7dcf12a-25a2-4ec0-96bf-7961fa19facc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:19 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Volume 8617c32e-2712-4b8d-a19d-89bf7ab64bf6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6', 'volume_size': 1, 'snapshot_id': '52aece7d-59b4-4c0c-8b2b-97a3bb29ac72'}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.392s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Deleted volume successfully.
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "cinder-quobyte-1635a3d0-4793-4c9d-b718-349661a05b5e" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2aef4f8e-ee4b-4598-ad5d-07129c3663dc tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-918a48e1-36d2-4811-8e5a-157cc2c43f0a-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-quobyte-1635a3d0-4793-4c9d-b718-349661a05b5e" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd22171c-bd62-433d-8c43-9001981de1e6]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1635a3d0-4793-4c9d-b718-349661a05b5e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:19 devstack sudo[114043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1635a3d0-4793-4c9d-b718-349661a05b5e
Aug 26 17:24:19 devstack sudo[114043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:19 devstack sudo[114037]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8 1073741824" returned: 0 in 0.503s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:19 devstack sudo[114046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8
Aug 26 17:24:19 devstack sudo[114046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:19 devstack sudo[114043]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1635a3d0-4793-4c9d-b718-349661a05b5e" returned: 0 in 0.401s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1635a3d0-4793-4c9d-b718-349661a05b5e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:19 devstack sudo[114051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1635a3d0-4793-4c9d-b718-349661a05b5e
Aug 26 17:24:19 devstack sudo[114051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:19 devstack sudo[114046]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8" returned: 0 in 0.277s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.362s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-309308272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70ba02b-683b-47a1-b428-4ea704acc335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ca3db26a3d4e21987349d5916c0167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:12Z,use_quota=True,user_id='2f917f7d0f9d40b6aac7155c6b7f083b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Creating volume c70ba02b-683b-47a1-b428-4ea704acc335 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:19 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c70ba02b-683b-47a1-b428-4ea704acc335 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62fa386-fb1d-4699-9f27-65978bcbc965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:19 devstack sudo[114054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c70ba02b-683b-47a1-b428-4ea704acc335 1073741824
Aug 26 17:24:19 devstack sudo[114054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef971a55-23b5-4356-8db0-929285c729b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:19 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8 (e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8): created successfully
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef971a55-23b5-4356-8db0-929285c729b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Flow 'volume_create_manager' (82d6fca2-d281-4567-a2fc-f5e5cec9db68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b4b5202e-bc59-4c2d-9e6f-af4300061c5f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Created volume successfully.
Aug 26 17:24:19 devstack sudo[114051]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-1635a3d0-4793-4c9d-b718-349661a05b5e" returned: 0 in 0.246s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-quobyte-1635a3d0-4793-4c9d-b718-349661a05b5e" released by "delete_volume" :: held 0.698s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:19 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Created reservations ['cda53711-e336-4911-b15a-ada0bf3ed393', '59abe4df-1104-490a-a955-e58c102c13a6', '48dcf5d6-4271-430e-bb48-6af52893ce14', '760e5dec-8ea7-4975-a25a-3ad0371bbfce'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:20 devstack sudo[114060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:20 devstack sudo[114060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:20 devstack sudo[114054]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c70ba02b-683b-47a1-b428-4ea704acc335 1073741824" returned: 0 in 0.469s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "cinder-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c70ba02b-683b-47a1-b428-4ea704acc335 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:20 devstack sudo[114064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c70ba02b-683b-47a1-b428-4ea704acc335
Aug 26 17:24:20 devstack sudo[114064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:20 devstack sudo[114060]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.290s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "cinder-quobyte-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:20 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Deleted volume successfully.
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-quobyte-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-69589885-08cb-4a41-9ac9-3ed7172d84b1 tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-1635a3d0-4793-4c9d-b718-349661a05b5e-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a20dcae-7335-4ebf-b31a-6fe4be8dd7ac]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:20 devstack sudo[114066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74
Aug 26 17:24:20 devstack sudo[114066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:20 devstack sudo[114064]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c70ba02b-683b-47a1-b428-4ea704acc335" returned: 0 in 0.275s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.090s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16813727-9e42-4029-8fc9-57ea1391cd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9b9f0a554934e06a3acc0c70a5b7ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:12Z,use_quota=True,user_id='f228445c914d43b1b8cf1f5f5dfad5f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e95c9c02-2584-4046-88c1-722b957a41b0),volume_type_id=e95c9c02-2584-4046-88c1-722b957a41b0)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Creating volume 16813727-9e42-4029-8fc9-57ea1391cd5c {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:20 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10488d2-7ccb-491b-85e8-ca775ce6b6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70ba02b-683b-47a1-b428-4ea704acc335', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b7dcc7f-3021-4bff-9d07-445be9db84ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:20 devstack sudo[114069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c 1073741824
Aug 26 17:24:20 devstack sudo[114069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:20 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Volume volume-c70ba02b-683b-47a1-b428-4ea704acc335 (c70ba02b-683b-47a1-b428-4ea704acc335): created successfully
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b7dcc7f-3021-4bff-9d07-445be9db84ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Flow 'volume_create_manager' (992fcd18-5e10-4566-b53c-b3740bf0c484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:20 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ca33b3dc-8056-49db-90ef-90c7a659b2ac tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Created volume successfully.
Aug 26 17:24:20 devstack sudo[114066]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74" returned: 0 in 0.440s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "cinder-c70ba02b-683b-47a1-b428-4ea704acc335-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:20 devstack sudo[114077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74
Aug 26 17:24:20 devstack sudo[114077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-c70ba02b-683b-47a1-b428-4ea704acc335-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "cinder-quobyte-c70ba02b-683b-47a1-b428-4ea704acc335" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-quobyte-c70ba02b-683b-47a1-b428-4ea704acc335" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e967bb06-82b8-4819-999a-8370b04ccc85]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c70ba02b-683b-47a1-b428-4ea704acc335 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:21 devstack sudo[114081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c70ba02b-683b-47a1-b428-4ea704acc335
Aug 26 17:24:21 devstack sudo[114081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:21 devstack sudo[114069]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c 1073741824" returned: 0 in 0.544s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:21 devstack sudo[114077]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74" returned: 0 in 0.280s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-quobyte-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74" released by "delete_volume" :: held 0.768s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Created reservations ['6b7687b9-db37-4f67-842f-bc5b20cf53c2', 'cf7e2069-ed2a-4eb2-8d3b-aee12ab2bbce', 'e0ad9bef-d600-4e15-ab0b-d40d2b6d7cf9', '00641e5d-c2e3-49db-b8e6-fadd502f35e0'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:21 devstack sudo[114084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c
Aug 26 17:24:21 devstack sudo[114084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:21 devstack sudo[114086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:21 devstack sudo[114086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:21 devstack sudo[114081]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c70ba02b-683b-47a1-b428-4ea704acc335" returned: 0 in 0.438s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c70ba02b-683b-47a1-b428-4ea704acc335 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:21 devstack sudo[114092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c70ba02b-683b-47a1-b428-4ea704acc335
Aug 26 17:24:21 devstack sudo[114092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:21 devstack sudo[114084]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c" returned: 0 in 0.306s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.343s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Acquiring lock "cinder-quobyte-52aece7d-59b4-4c0c-8b2b-97a3bb29ac72-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" by "_create_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Lock "cinder-quobyte-52aece7d-59b4-4c0c-8b2b-97a3bb29ac72-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Creating volume 8617c32e-2712-4b8d-a19d-89bf7ab64bf6 from snapshot 52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 {{(pid=94125) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Acquiring lock "cinder-quobyte-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" by "_copy_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Attempting download of eab8714d-2d69-4cbd-90d9-e4363801a5d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'metadata': {}}])) to volume 16813727-9e42-4029-8fc9-57ea1391cd5c. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Lock "cinder-quobyte-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] snapshot: 52aece7d-59b4-4c0c-8b2b-97a3bb29ac72, volume: 8617c32e-2712-4b8d-a19d-89bf7ab64bf6,  {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:21 devstack sudo[114086]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.357s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c044147-31a4-4df9-a614-75e757314882]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99e6d46-aeb3-41d3-be93-7424dfbfccc5]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eab8714d-2d69-4cbd-90d9-e4363801a5d7_81gtxz15 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:21 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Deleted volume successfully.
Aug 26 17:24:21 devstack sudo[114092]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c70ba02b-683b-47a1-b428-4ea704acc335" returned: 0 in 0.331s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-608972d1-37b0-407c-bd7e-20ce67008fb9 tempest-CreateVolumesFromImageTest-856054990 None] Lock "cinder-3f2b18fa-0cd1-41e1-ba09-f9cbc4a26b74-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-quobyte-c70ba02b-683b-47a1-b428-4ea704acc335" released by "delete_volume" :: held 0.811s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:21 devstack sudo[114097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72
Aug 26 17:24:21 devstack sudo[114097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Created reservations ['72528711-8eae-445a-aaed-af3f11185246', '747e07a9-6599-445f-a0b8-d3d8d8f6e5ad', '7dc88b82-93a8-4692-9739-da7753147681', '534f99ac-b499-477f-bd00-e38859fb3172'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:21 devstack sudo[114098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eab8714d-2d69-4cbd-90d9-e4363801a5d7_81gtxz15
Aug 26 17:24:21 devstack sudo[114098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:21 devstack sudo[114101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:21 devstack sudo[114101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "cinder-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:22 devstack sudo[114097]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "cinder-quobyte-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72" returned: 0 in 0.516s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8554b51c-a208-4980-a698-8bc252572fcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10e099f-1845-46aa-9618-59ee0deee81c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:22 devstack sudo[114098]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-quobyte-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8" acquired by "delete_volume" :: waited 0.043s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eab8714d-2d69-4cbd-90d9-e4363801a5d7_81gtxz15" returned: 0 in 0.562s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eab8714d-2d69-4cbd-90d9-e4363801a5d7_81gtxz15 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2f8c3e-3942-43f2-b53c-1e49eab480a4]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:22 devstack sudo[114101]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.395s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:22 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Deleted volume successfully.
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f348ad89-9e96-49a3-94bb-ff200d13147f tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-c70ba02b-683b-47a1-b428-4ea704acc335-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:22 devstack sudo[114108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb
Aug 26 17:24:22 devstack sudo[114108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:22 devstack sudo[114110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eab8714d-2d69-4cbd-90d9-e4363801a5d7_81gtxz15
Aug 26 17:24:22 devstack sudo[114110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:22 devstack sudo[114111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8
Aug 26 17:24:22 devstack sudo[114111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:22 devstack sudo[114108]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb" returned: 0 in 0.436s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Creating direct copy from snapshot {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG cinder.utils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Path /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6 not found in is_blk_device check {{(pid=94125) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:22 devstack sudo[114110]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eab8714d-2d69-4cbd-90d9-e4363801a5d7_81gtxz15" returned: 1 in 0.447s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eab8714d-2d69-4cbd-90d9-e4363801a5d7_81gtxz15' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a027b20-62bc-4feb-ae46-6f441a76c672]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:22 devstack sudo[114121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6
Aug 26 17:24:22 devstack sudo[114121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:22 devstack sudo[114111]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8" returned: 0 in 0.542s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:22 devstack sudo[114127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8
Aug 26 17:24:22 devstack sudo[114127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:22 devstack sudo[114124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD
Aug 26 17:24:22 devstack sudo[114124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:23 devstack sudo[114124]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD" returned: 0 in 0.428s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:23 devstack sudo[114127]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8" returned: 0 in 0.338s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:23 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-quobyte-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8" released by "delete_volume" :: held 0.944s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:23 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Created reservations ['b39b3a9b-3ec3-4c0f-9d58-758003740fb6', '4fd225b4-7d13-4efc-a624-f987fdd939e4', '083a4aa2-a2f5-472e-89b5-8cfdaa088cdc', '07a8ffd2-d618-43e9-8d16-198b8823174b'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:23 devstack sudo[114137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD
Aug 26 17:24:23 devstack sudo[114137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:23 devstack sudo[114145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:23 devstack sudo[114145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:24 devstack sudo[114137]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD" returned: 1 in 0.921s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] eab8714d-2d69-4cbd-90d9-e4363801a5d7 was raw, converting to qcow2 {{(pid=94125) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:24 devstack sudo[114150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c
Aug 26 17:24:24 devstack sudo[114150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:24 devstack sudo[114145]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.820s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:24 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Deleted volume successfully.
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b61cc36b-0b56-47b4-925a-e9900784c421 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-e805fc30-2d8c-4bbf-83bc-4ac5d3d58bc8-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "cinder-62b08365-c5bb-4cb7-9002-5054648fd35b-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-62b08365-c5bb-4cb7-9002-5054648fd35b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "cinder-quobyte-62b08365-c5bb-4cb7-9002-5054648fd35b" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-quobyte-62b08365-c5bb-4cb7-9002-5054648fd35b" acquired by "delete_volume" :: waited 0.041s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[be59eaae-fdc2-4a71-b96e-53c8fbc77647]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62b08365-c5bb-4cb7-9002-5054648fd35b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:25 devstack sudo[114156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62b08365-c5bb-4cb7-9002-5054648fd35b
Aug 26 17:24:25 devstack sudo[114156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:25 devstack sudo[114156]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62b08365-c5bb-4cb7-9002-5054648fd35b" returned: 0 in 0.703s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62b08365-c5bb-4cb7-9002-5054648fd35b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:25 devstack sudo[114196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62b08365-c5bb-4cb7-9002-5054648fd35b
Aug 26 17:24:25 devstack sudo[114196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:25 devstack sudo[114150]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c" returned: 0 in 1.651s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:25 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eab8714d-2d69-4cbd-90d9-e4363801a5d7_cqitkgo_devstack@QuobyteHD, size 0.00 MB, duration 1.66 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:24:25 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Converted 0.00 MB image at 0.00 MB/s
Aug 26 17:24:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:25 devstack sudo[114198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c 1G
Aug 26 17:24:25 devstack sudo[114198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:26 devstack sudo[114196]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62b08365-c5bb-4cb7-9002-5054648fd35b" returned: 0 in 0.759s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-quobyte-62b08365-c5bb-4cb7-9002-5054648fd35b" released by "delete_volume" :: held 1.573s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Created reservations ['fa2195ec-0428-4deb-b2c5-6456a4888202', '7ca4bc12-e712-41a0-b9c5-f7bfb7b96baa', 'e519e902-5edc-438c-bf84-9f96a8874fe5', '9bb00613-17d1-4c28-8b36-47f1957d3e19'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:26 devstack sudo[114198]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c 1G" returned: 0 in 1.122s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Downloaded image eab8714d-2d69-4cbd-90d9-e4363801a5d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'metadata': {}}])) to volume 16813727-9e42-4029-8fc9-57ea1391cd5c successfully. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Temporary image eab8714d-2d69-4cbd-90d9-e4363801a5d7 for user f228445c914d43b1b8cf1f5f5dfad5f4 is deleted. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Marking volume 16813727-9e42-4029-8fc9-57ea1391cd5c as bootable. {{(pid=94125) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 17:24:26 devstack sudo[114207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:26 devstack sudo[114207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Copying metadata from image eab8714d-2d69-4cbd-90d9-e4363801a5d7 to 16813727-9e42-4029-8fc9-57ea1391cd5c. {{(pid=94125) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 17:24:26 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Creating volume glance metadata for volume 16813727-9e42-4029-8fc9-57ea1391cd5c backed by image eab8714d-2d69-4cbd-90d9-e4363801a5d7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2f54da357dff8b6e0e25418c3af63bd7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94125) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0d1a0b-1b9f-4b5e-b3c0-c793de2161e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16813727-9e42-4029-8fc9-57ea1391cd5c', 'volume_size': 1, 'image_id': 'eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2f54da357dff8b6e0e25418c3af63bd7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9b9f0a554934e06a3acc0c70a5b7ba7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '465f4b8f77a5679efa0e2dffa717a428531767334bb7481e259346d2aaa3cedb94c172604092ac6e4243f013d15494fe6cb7b8178a4f658d7b7b8a37387f0070', 'id': 'eab8714d-2d69-4cbd-90d9-e4363801a5d7', 'created_at': datetime.datetime(2026, 8, 26, 15, 24, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 24, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eab8714d-2d69-4cbd-90d9-e4363801a5d7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901fd1eee10>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83282852-5971-450e-a24e-571911d5fc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:27 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Volume volume-16813727-9e42-4029-8fc9-57ea1391cd5c (16813727-9e42-4029-8fc9-57ea1391cd5c): created successfully
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83282852-5971-450e-a24e-571911d5fc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Flow 'volume_create_manager' (84704c8b-d3d5-4af6-8a7e-9e136bdfb726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:27 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-aac6d536-fb13-4a5c-819d-63ab214c99ac tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Created volume successfully.
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "cinder-f3eaeb63-8f77-48ef-b18d-45edb74183d3-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-f3eaeb63-8f77-48ef-b18d-45edb74183d3-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:27 devstack sudo[114207]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.617s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:27 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Deleted volume successfully.
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0a954e26-11d3-4131-a666-d576249e8d85 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-62b08365-c5bb-4cb7-9002-5054648fd35b-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "cinder-quobyte-f3eaeb63-8f77-48ef-b18d-45edb74183d3" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-quobyte-f3eaeb63-8f77-48ef-b18d-45edb74183d3" acquired by "delete_volume" :: waited 0.050s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c94fd0b-b3ec-4142-a1e0-9e19d4e00403]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Acquiring lock "cinder-16813727-9e42-4029-8fc9-57ea1391cd5c-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Flow 'volume_create_manager' (81880601-bea6-4575-bd38-793d4cd9feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3357b0c-d603-4962-b69d-570191f8da50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3357b0c-d603-4962-b69d-570191f8da50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8622e1-0d36-47ff-be9f-11141b3371e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f57f42d0d35479ebfe0922c82aabae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:28Z,use_quota=True,user_id='235b3efeb532485ba126a3a7e136d260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f488db6-ec99-46fa-96f4-a5a42251e88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f488db6-ec99-46fa-96f4-a5a42251e88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b19fd2-7bee-4f65-a693-d702ea616647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:27 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b19fd2-7bee-4f65-a693-d702ea616647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c8622e1-0d36-47ff-be9f-11141b3371e8', 'volume_name': 'volume-4c8622e1-0d36-47ff-be9f-11141b3371e8', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:27 devstack sudo[114211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3
Aug 26 17:24:27 devstack sudo[114211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6df0931-c214-4122-9685-48e74aab4282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6df0931-c214-4122-9685-48e74aab4282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90b142c-1343-48fe-a5f0-c55e33f5f430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:28 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Volume 4c8622e1-0d36-47ff-be9f-11141b3371e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c8622e1-0d36-47ff-be9f-11141b3371e8', 'volume_size': 1}
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Lock "cinder-16813727-9e42-4029-8fc9-57ea1391cd5c-delete_volume" acquired by "delete_volume" :: waited 0.266s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Acquiring lock "cinder-quobyte-16813727-9e42-4029-8fc9-57ea1391cd5c" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Lock "cinder-quobyte-16813727-9e42-4029-8fc9-57ea1391cd5c" acquired by "delete_volume" :: waited 0.040s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[6632b4bc-9314-49b0-9df3-6f111dfca4d9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:28 devstack sudo[114211]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3" returned: 0 in 0.823s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:28 devstack sudo[114213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c
Aug 26 17:24:28 devstack sudo[114213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:28 devstack sudo[114218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3
Aug 26 17:24:28 devstack sudo[114218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:28 devstack sudo[114121]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" returned: 0 in 6.133s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:24:28 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Converted 1024.00 MB image at 166.84 MB/s
Aug 26 17:24:28 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6 is being set with open permissions: ugo+rw
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:28 devstack sudo[114227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6
Aug 26 17:24:28 devstack sudo[114227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:28 devstack sudo[114213]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c" returned: 0 in 0.615s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:28 devstack sudo[114231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c
Aug 26 17:24:28 devstack sudo[114231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:28 devstack sudo[114218]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f3eaeb63-8f77-48ef-b18d-45edb74183d3" returned: 0 in 0.442s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-quobyte-f3eaeb63-8f77-48ef-b18d-45edb74183d3" released by "delete_volume" :: held 1.406s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Created reservations ['130a20c1-1029-4b8f-99ce-3c4dedf49334', 'db1f8554-bf1e-4683-b51f-090ad80bbb5c', 'e4bd401d-bbfe-4285-8190-4b027f609230', '8926e1aa-09be-4393-9279-c1cd1dafbc7c'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:29 devstack sudo[114227]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" returned: 0 in 0.263s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Lock "cinder-quobyte-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" released by "_copy_volume_from_snapshot" :: held 7.507s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:29 devstack sudo[114236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:29 devstack sudo[114236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:29 devstack sudo[114231]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Lock "cinder-quobyte-52aece7d-59b4-4c0c-8b2b-97a3bb29ac72-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" released by "_create_volume_from_snapshot" :: held 7.614s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.647s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.132s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8622e1-0d36-47ff-be9f-11141b3371e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f57f42d0d35479ebfe0922c82aabae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:28Z,use_quota=True,user_id='235b3efeb532485ba126a3a7e136d260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Creating volume 4c8622e1-0d36-47ff-be9f-11141b3371e8 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:29 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c8622e1-0d36-47ff-be9f-11141b3371e8 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-16813727-9e42-4029-8fc9-57ea1391cd5c" returned: 0 in 0.322s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:29 devstack sudo[114238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c8622e1-0d36-47ff-be9f-11141b3371e8 1073741824
Aug 26 17:24:29 devstack sudo[114238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Lock "cinder-quobyte-16813727-9e42-4029-8fc9-57ea1391cd5c" released by "delete_volume" :: held 1.032s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7dcf12a-25a2-4ec0-96bf-7961fa19facc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6', 'volume_size': 1, 'snapshot_id': '52aece7d-59b4-4c0c-8b2b-97a3bb29ac72'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6279bb71-b192-4604-a317-1dd54234706d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:29 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Volume volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6 (8617c32e-2712-4b8d-a19d-89bf7ab64bf6): created successfully
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6279bb71-b192-4604-a317-1dd54234706d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Flow 'volume_create_manager' (6f4a5f5a-2cb0-42b3-943a-0c864eb47ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-569e8e7c-4f2d-4761-9755-2135d2b5c335 tempest-VolumeDependencyTests-348588549 None] Created volume successfully.
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Created reservations ['2c3f93b3-5ae0-4f5e-9850-8f383181d1c8', '97c96b86-31fa-466c-a887-ee06291ba616', 'aca0bb97-3958-45b5-a8d0-1d719751b149', '2d384c86-3905-48d0-abfb-47a743de3e9c'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:29 devstack sudo[114236]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.287s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Deleted volume successfully.
Aug 26 17:24:29 devstack sudo[114241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:29 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e5f46a33-f623-45e5-8d6c-6e79573ee620 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-f3eaeb63-8f77-48ef-b18d-45edb74183d3-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "cinder-eeabca87-2ac6-4372-900f-81337284bf9c-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-eeabca87-2ac6-4372-900f-81337284bf9c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "cinder-quobyte-eeabca87-2ac6-4372-900f-81337284bf9c" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-quobyte-eeabca87-2ac6-4372-900f-81337284bf9c" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77aef4e-a773-4e2d-b2f4-b3c6764ae289]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eeabca87-2ac6-4372-900f-81337284bf9c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:29 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.279s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:29 devstack sudo[114238]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c8622e1-0d36-47ff-be9f-11141b3371e8 1073741824" returned: 0 in 0.506s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Deleted volume successfully.
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6a421568-20bc-47ea-aec0-6a01dfa40a79 tempest-VolumeAndVolumeTypeFromImageTest-103055976 None] Lock "cinder-16813727-9e42-4029-8fc9-57ea1391cd5c-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c8622e1-0d36-47ff-be9f-11141b3371e8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:29 devstack sudo[114249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c8622e1-0d36-47ff-be9f-11141b3371e8
Aug 26 17:24:29 devstack sudo[114249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:29 devstack sudo[114248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eeabca87-2ac6-4372-900f-81337284bf9c
Aug 26 17:24:29 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:29 devstack sudo[114249]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c8622e1-0d36-47ff-be9f-11141b3371e8" returned: 0 in 0.243s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:29 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90b142c-1343-48fe-a5f0-c55e33f5f430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c8622e1-0d36-47ff-be9f-11141b3371e8', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d17da04-10fa-4bda-8cd1-6b01c60296b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:30 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Volume volume-4c8622e1-0d36-47ff-be9f-11141b3371e8 (4c8622e1-0d36-47ff-be9f-11141b3371e8): created successfully
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d17da04-10fa-4bda-8cd1-6b01c60296b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Flow 'volume_create_manager' (81880601-bea6-4575-bd38-793d4cd9feb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:30 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eeabca87-2ac6-4372-900f-81337284bf9c" returned: 0 in 0.361s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eeabca87-2ac6-4372-900f-81337284bf9c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:30 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f7ec31c4-8fbc-44d1-a8d0-7c0fcac348d2 tempest-CinderUnicodeTest-278837014 None] Created volume successfully.
Aug 26 17:24:30 devstack sudo[114256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eeabca87-2ac6-4372-900f-81337284bf9c
Aug 26 17:24:30 devstack sudo[114256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Acquiring lock "cinder-52aece7d-59b4-4c0c-8b2b-97a3bb29ac72-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Lock "cinder-52aece7d-59b4-4c0c-8b2b-97a3bb29ac72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Acquiring lock "cinder-quobyte-8554b51c-a208-4980-a698-8bc252572fcb" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:30 devstack sudo[114256]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-eeabca87-2ac6-4372-900f-81337284bf9c" returned: 0 in 0.288s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-quobyte-eeabca87-2ac6-4372-900f-81337284bf9c" released by "delete_volume" :: held 0.688s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Lock "cinder-quobyte-8554b51c-a208-4980-a698-8bc252572fcb" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Acquiring lock "cinder-quobyte-52aece7d-59b4-4c0c-8b2b-97a3bb29ac72" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Lock "cinder-quobyte-52aece7d-59b4-4c0c-8b2b-97a3bb29ac72" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Deleting offline snapshot 52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 of volume 8554b51c-a208-4980-a698-8bc252572fcb {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] snapshot_file for this snap is: volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec1cd32-0d03-4eb3-8b07-fd9c0ef40f66]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Created reservations ['a9eb5729-31b3-4915-835f-c87d61729060', 'e56d4c67-8501-4ab8-8985-0f47bef0b751', 'a7c51ef3-f17a-4867-a2f8-18fd80e8dff9', '4d0d4549-1a8d-4583-8156-284c6b4e00b0'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:30 devstack sudo[114259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72
Aug 26 17:24:30 devstack sudo[114259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:30 devstack sudo[114261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:30 devstack sudo[114261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "cinder-d1fee682-56c3-4b1d-b979-946d8925c9a8-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-d1fee682-56c3-4b1d-b979-946d8925c9a8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "cinder-quobyte-d1fee682-56c3-4b1d-b979-946d8925c9a8" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:30 devstack sudo[114261]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.313s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:30 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Deleted volume successfully.
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-quobyte-d1fee682-56c3-4b1d-b979-946d8925c9a8" acquired by "delete_volume" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:30 devstack sudo[114259]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-0a5bde1e-f9e7-453d-8182-a4e2fb3571c0 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-eeabca87-2ac6-4372-900f-81337284bf9c-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72" returned: 0 in 0.501s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8554b51c-a208-4980-a698-8bc252572fcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c6f27c-06e7-4779-b082-0a96fd9d54ab]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d1fee682-56c3-4b1d-b979-946d8925c9a8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[add6f38f-6925-4ff9-9f25-4cfd1a38edc9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:31 devstack sudo[114268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb
Aug 26 17:24:31 devstack sudo[114268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:31 devstack sudo[114267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d1fee682-56c3-4b1d-b979-946d8925c9a8
Aug 26 17:24:31 devstack sudo[114267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Flow 'volume_create_manager' (709c49e8-3bc7-47e7-95d9-f2e3cace50c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f9ca34-d149-45d2-8d72-fc1653a7fd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f9ca34-d149-45d2-8d72-fc1653a7fd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1960268058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce5b5f7-dd61-4783-962d-7f36f6682527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f57f42d0d35479ebfe0922c82aabae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:31Z,use_quota=True,user_id='235b3efeb532485ba126a3a7e136d260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c22020-547d-4514-a4d0-b5942e5550cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c22020-547d-4514-a4d0-b5942e5550cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:31 devstack sudo[114267]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a0b7fa-e322-4d5e-9696-5a18435a3a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a0b7fa-e322-4d5e-9696-5a18435a3a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce5b5f7-dd61-4783-962d-7f36f6682527', 'volume_name': 'volume-4ce5b5f7-dd61-4783-962d-7f36f6682527', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e027ef1f-a5e6-430a-95d6-1e5fbfcc4e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e027ef1f-a5e6-430a-95d6-1e5fbfcc4e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3a7007-c411-42c0-b71e-429dfe1fcac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:31 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Volume 4ce5b5f7-dd61-4783-962d-7f36f6682527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce5b5f7-dd61-4783-962d-7f36f6682527', 'volume_size': 1}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1960268058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce5b5f7-dd61-4783-962d-7f36f6682527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f57f42d0d35479ebfe0922c82aabae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:31Z,use_quota=True,user_id='235b3efeb532485ba126a3a7e136d260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Creating volume 4ce5b5f7-dd61-4783-962d-7f36f6682527 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:31 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d1fee682-56c3-4b1d-b979-946d8925c9a8" returned: 0 in 0.542s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d1fee682-56c3-4b1d-b979-946d8925c9a8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:31 devstack sudo[114277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527 1073741824
Aug 26 17:24:31 devstack sudo[114277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:31 devstack sudo[114278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d1fee682-56c3-4b1d-b979-946d8925c9a8
Aug 26 17:24:31 devstack sudo[114278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:31 devstack sudo[114268]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb" returned: 0 in 0.652s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:31 devstack sudo[114282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72
Aug 26 17:24:31 devstack sudo[114282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:31 devstack sudo[114278]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d1fee682-56c3-4b1d-b979-946d8925c9a8" returned: 0 in 0.329s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-quobyte-d1fee682-56c3-4b1d-b979-946d8925c9a8" released by "delete_volume" :: held 0.947s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Created reservations ['9945d7bf-995a-4e99-8919-9d09670817b2', '25d2ca36-d67f-440b-935f-21dab00b563d', 'c0e150c6-a5fa-42b0-ac46-075ed7011891', '71b72ad4-edf3-4500-b3b1-f5af09b57451'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:32 devstack sudo[114292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:32 devstack sudo[114292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:32 devstack sudo[114277]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527 1073741824" returned: 0 in 0.591s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:32 devstack sudo[114282]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72" returned: 0 in 0.489s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:32 devstack sudo[114294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72
Aug 26 17:24:32 devstack sudo[114294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:32 devstack sudo[114295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527
Aug 26 17:24:32 devstack sudo[114295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:32 devstack sudo[114292]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.291s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:32 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Deleted volume successfully.
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-5d2af5ad-9a2c-4077-a270-ae588684abc1 tempest-CreateVolumesFromSourceVolumeTest-1600790504 None] Lock "cinder-d1fee682-56c3-4b1d-b979-946d8925c9a8-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:32 devstack sudo[114294]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb.52aece7d-59b4-4c0c-8b2b-97a3bb29ac72" returned: 0 in 0.347s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Lock "cinder-quobyte-52aece7d-59b4-4c0c-8b2b-97a3bb29ac72" released by "_delete_snapshot" :: held 2.116s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:32 devstack sudo[114295]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Lock "cinder-quobyte-8554b51c-a208-4980-a698-8bc252572fcb" released by "delete_snapshot" :: held 2.152s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527" returned: 0 in 0.390s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3a7007-c411-42c0-b71e-429dfe1fcac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce5b5f7-dd61-4783-962d-7f36f6682527', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3065e65-14b9-42a9-a920-73bc76937b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:32 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Volume volume-4ce5b5f7-dd61-4783-962d-7f36f6682527 (4ce5b5f7-dd61-4783-962d-7f36f6682527): created successfully
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3065e65-14b9-42a9-a920-73bc76937b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Flow 'volume_create_manager' (709c49e8-3bc7-47e7-95d9-f2e3cace50c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:32 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-9e32b980-d1cc-4de9-94b8-c71414f18ba8 tempest-CinderUnicodeTest-278837014 None] Created volume successfully.
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Created reservations ['a7729486-2599-4034-aed2-957384fe26be', '4c52da50-a4bf-48f1-83dc-c5839200cbfc', '2449c0db-0444-4edf-a980-a473313e5d37', 'a1a2a5e9-4f3f-426e-89d1-3a33162a96ac'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:32 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Delete snapshot completed successfully.
Aug 26 17:24:32 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e0e9ecec-c406-4f80-b0e9-0261e3f4006c tempest-VolumeDependencyTests-348588549 None] Lock "cinder-52aece7d-59b4-4c0c-8b2b-97a3bb29ac72-delete_snapshot" released by "delete_snapshot" :: held 2.395s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Acquiring lock "cinder-8554b51c-a208-4980-a698-8bc252572fcb-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Lock "cinder-8554b51c-a208-4980-a698-8bc252572fcb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Acquiring lock "cinder-quobyte-8554b51c-a208-4980-a698-8bc252572fcb" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Lock "cinder-quobyte-8554b51c-a208-4980-a698-8bc252572fcb" acquired by "delete_volume" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:33 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[17613e21-08ab-4451-8605-2513075658df]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] Creating offline snapshot f3b6f1db-79ae-4e27-afc3-4624563ac4b9 of volume 4ce5b5f7-dd61-4783-962d-7f36f6682527 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:24:33 devstack sudo[114301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb
Aug 26 17:24:33 devstack sudo[114301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:33 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dc0b01-af03-476b-ab82-699803dfc299]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:34 devstack sudo[114303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527
Aug 26 17:24:34 devstack sudo[114303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:34 devstack sudo[114301]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb" returned: 0 in 0.489s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:34 devstack sudo[114308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb
Aug 26 17:24:34 devstack sudo[114308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:34 devstack sudo[114303]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527" returned: 0 in 0.501s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:34 devstack sudo[114314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9 1G
Aug 26 17:24:34 devstack sudo[114314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:34 devstack sudo[114308]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8554b51c-a208-4980-a698-8bc252572fcb" returned: 0 in 0.301s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Lock "cinder-quobyte-8554b51c-a208-4980-a698-8bc252572fcb" released by "delete_volume" :: held 0.886s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Created reservations ['3af95ccb-8518-4e4e-8a03-ff253fb50163', 'c25f123b-4af0-42b1-94b1-a06daf9f6cb3', '33d9f0a9-aea4-4d13-b75f-1c624cf7a7b1', '30a41ea1-32b0-47e0-ae0f-cf2dae722ca4'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:34 devstack sudo[114321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:34 devstack sudo[114321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Acquiring lock "cinder-8617c32e-2712-4b8d-a19d-89bf7ab64bf6-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Lock "cinder-8617c32e-2712-4b8d-a19d-89bf7ab64bf6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Acquiring lock "cinder-quobyte-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:34 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Lock "cinder-quobyte-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4fc917-b199-471c-921f-6fc6b4d95c85]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:35 devstack sudo[114314]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9 1G" returned: 0 in 0.622s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce5b5f7-dd61-4783-962d-7f36f6682527 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:35 devstack sudo[114325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce5b5f7-dd61-4783-962d-7f36f6682527 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9
Aug 26 17:24:35 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:35 devstack sudo[114324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6
Aug 26 17:24:35 devstack sudo[114324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:35 devstack sudo[114321]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.447s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:35 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Deleted volume successfully.
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2aaf3348-d2e1-4a15-94bf-d21d828ab97e tempest-VolumeDependencyTests-348588549 None] Lock "cinder-8554b51c-a208-4980-a698-8bc252572fcb-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:35 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce5b5f7-dd61-4783-962d-7f36f6682527 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9" returned: 0 in 0.423s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:35 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9 is being set with open permissions: ugo+rw
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:35 devstack sudo[114334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9
Aug 26 17:24:35 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:35 devstack sudo[114324]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" returned: 0 in 0.548s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:35 devstack sudo[114338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6
Aug 26 17:24:35 devstack sudo[114338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Flow 'volume_create_manager' (838f4961-874a-42ec-ba1c-6a160eecdc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659a86ac-ef94-40ed-9c47-60a421f6c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659a86ac-ef94-40ed-9c47-60a421f6c940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1877337493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ef9d41-7f6a-40be-afd8-96bb51cf7f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477fe42286004bd5b9a4ac06b4e4b83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:36Z,use_quota=True,user_id='78d4b2aee4164822be94e291c76acfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f5698f-5d35-47a1-9435-ee1c94d26d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f5698f-5d35-47a1-9435-ee1c94d26d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f7c194-b053-41ac-aa29-81b4afafb126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f7c194-b053-41ac-aa29-81b4afafb126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ef9d41-7f6a-40be-afd8-96bb51cf7f3e', 'volume_name': 'volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fb6797-24c6-4c90-8968-caf5931fec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fb6797-24c6-4c90-8968-caf5931fec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffc3692-64f3-44c7-a453-1c5291eec815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:35 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume 76ef9d41-7f6a-40be-afd8-96bb51cf7f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e', 'volume_size': 1}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:35 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9" returned: 0 in 0.305s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:35 devstack sudo[114342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.info
Aug 26 17:24:35 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:35 devstack sudo[114338]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" returned: 0 in 0.288s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Lock "cinder-quobyte-8617c32e-2712-4b8d-a19d-89bf7ab64bf6" released by "delete_volume" :: held 0.882s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:35 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Created reservations ['398acc26-7531-4241-ae22-7f62129b94ce', '33de70c5-eb58-4a9c-9ebd-2c21d74f1b62', '1ee236b0-d33b-4d82-8261-3ad45b46559b', '8a982dea-427e-4f21-82ff-f0170106a063'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:36 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.info" returned: 0 in 0.271s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:36 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.info is being set with open permissions: ugo+rw
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:36 devstack sudo[114345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:36 devstack sudo[114345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:36 devstack sudo[114347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.info
Aug 26 17:24:36 devstack sudo[114347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:36 devstack sudo[114345]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.264s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Deleted volume successfully.
Aug 26 17:24:36 devstack sudo[114347]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.info" returned: 0 in 0.266s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.677s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1877337493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ef9d41-7f6a-40be-afd8-96bb51cf7f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477fe42286004bd5b9a4ac06b4e4b83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:36Z,use_quota=True,user_id='78d4b2aee4164822be94e291c76acfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Creating volume 76ef9d41-7f6a-40be-afd8-96bb51cf7f3e {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:36 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-05e1a5a1-5a7b-4e53-97b6-84ebee494910 tempest-VolumeDependencyTests-348588549 None] Lock "cinder-8617c32e-2712-4b8d-a19d-89bf7ab64bf6-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:36 devstack sudo[114352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e 1073741824
Aug 26 17:24:36 devstack sudo[114352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-fcbe0773-75e8-4438-9fd9-f2c9343838f1 tempest-CinderUnicodeTest-278837014 None] Create snapshot completed successfully
Aug 26 17:24:36 devstack sudo[114352]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e 1073741824" returned: 0 in 0.494s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:36 devstack sudo[114359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e
Aug 26 17:24:36 devstack sudo[114359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Acquiring lock "cinder-f3b6f1db-79ae-4e27-afc3-4624563ac4b9-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:37 devstack sudo[114359]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e" returned: 0 in 0.253s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffc3692-64f3-44c7-a453-1c5291eec815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a511c02-ffca-49fb-94f9-f47cde99f6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Lock "cinder-f3b6f1db-79ae-4e27-afc3-4624563ac4b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Acquiring lock "cinder-quobyte-4ce5b5f7-dd61-4783-962d-7f36f6682527" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Lock "cinder-quobyte-4ce5b5f7-dd61-4783-962d-7f36f6682527" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Acquiring lock "cinder-quobyte-f3b6f1db-79ae-4e27-afc3-4624563ac4b9" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:37 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e (76ef9d41-7f6a-40be-afd8-96bb51cf7f3e): created successfully
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a511c02-ffca-49fb-94f9-f47cde99f6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Flow 'volume_create_manager' (838f4961-874a-42ec-ba1c-6a160eecdc57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Lock "cinder-quobyte-f3b6f1db-79ae-4e27-afc3-4624563ac4b9" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Deleting offline snapshot f3b6f1db-79ae-4e27-afc3-4624563ac4b9 of volume 4ce5b5f7-dd61-4783-962d-7f36f6682527 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] snapshot_file for this snap is: volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:24:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-82e9d6c3-9cb0-4b31-b2f1-91edb00cde9e tempest-CreateVolumesFromSnapshotTest-43488183 None] Created volume successfully.
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee20986d-176c-4bdd-9191-970441465e4f]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b87efdc8-1ada-4eba-a462-dfcdd2f73a7b tempest-ProjectAdminTests-1491700594 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.723487854004, 'free_capacity_gb': 1774.723487854004, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94125) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 26 17:24:37 devstack sudo[114362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9
Aug 26 17:24:37 devstack sudo[114362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:37 devstack sudo[114362]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9" returned: 0 in 0.427s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ce5b5f7-dd61-4783-962d-7f36f6682527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a01269b-1db6-48ac-8db6-beb4fbbb1c89]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:37 devstack sudo[114367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527
Aug 26 17:24:37 devstack sudo[114367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Creating offline snapshot aad66fed-e6b2-4407-a786-8f4871496982 of volume 76ef9d41-7f6a-40be-afd8-96bb51cf7f3e {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:24:38 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e3b053-fd07-4952-85f7-8f50a729e82c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:38 devstack sudo[114369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e
Aug 26 17:24:38 devstack sudo[114369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:38 devstack sudo[114367]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527" returned: 0 in 0.501s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:38 devstack sudo[114375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9
Aug 26 17:24:38 devstack sudo[114375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:38 devstack sudo[114369]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e" returned: 0 in 0.522s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:38 devstack sudo[114380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982 1G
Aug 26 17:24:38 devstack sudo[114380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:38 devstack sudo[114375]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9" returned: 0 in 0.497s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:38 devstack sudo[114385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9
Aug 26 17:24:38 devstack sudo[114385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:39 devstack sudo[114385]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527.f3b6f1db-79ae-4e27-afc3-4624563ac4b9" returned: 0 in 0.350s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:39 devstack sudo[114380]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982 1G" returned: 0 in 0.623s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Lock "cinder-quobyte-f3b6f1db-79ae-4e27-afc3-4624563ac4b9" released by "_delete_snapshot" :: held 1.934s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Lock "cinder-quobyte-4ce5b5f7-dd61-4783-962d-7f36f6682527" released by "delete_snapshot" :: held 1.978s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:39 devstack sudo[114394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982
Aug 26 17:24:39 devstack sudo[114394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:39 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Created reservations ['71f90cf4-8bfb-4a26-9d15-4fe45b8f8eb8', '0afa7859-4f9c-433c-99a6-501b75bc018d', '747cc426-7219-422f-b204-d95026344c1d', 'f215e08b-4138-4172-88d3-68483a31defe'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:39 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Delete snapshot completed successfully.
Aug 26 17:24:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-6d9fdde4-88a3-4918-8ff2-72aa6925a223 tempest-CinderUnicodeTest-278837014 None] Lock "cinder-f3b6f1db-79ae-4e27-afc3-4624563ac4b9-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:39 devstack sudo[114394]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982" returned: 0 in 0.417s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:39 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982 is being set with open permissions: ugo+rw
Aug 26 17:24:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:39 devstack sudo[114399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982
Aug 26 17:24:39 devstack sudo[114399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:39 devstack sudo[114399]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982" returned: 0 in 0.260s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:39 devstack sudo[114402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.info
Aug 26 17:24:39 devstack sudo[114402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:40 devstack sudo[114402]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.info" returned: 0 in 0.277s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:40 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.info is being set with open permissions: ugo+rw
Aug 26 17:24:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:40 devstack sudo[114405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.info
Aug 26 17:24:40 devstack sudo[114405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:40 devstack sudo[114405]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.info" returned: 0 in 0.257s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Acquiring lock "cinder-4ce5b5f7-dd61-4783-962d-7f36f6682527-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Lock "cinder-4ce5b5f7-dd61-4783-962d-7f36f6682527-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:40 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f8664bb0-f761-48d3-ae45-c4165687d8f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Create snapshot completed successfully
Aug 26 17:24:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Acquiring lock "cinder-quobyte-4ce5b5f7-dd61-4783-962d-7f36f6682527" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Lock "cinder-quobyte-4ce5b5f7-dd61-4783-962d-7f36f6682527" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:40 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2d430b-5bb9-49fd-b692-647058a87db2]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:40 devstack sudo[114408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527
Aug 26 17:24:40 devstack sudo[114408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:40 devstack sudo[114408]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527" returned: 0 in 0.381s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:40 devstack sudo[114413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527
Aug 26 17:24:40 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:41 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4ce5b5f7-dd61-4783-962d-7f36f6682527" returned: 0 in 0.276s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Lock "cinder-quobyte-4ce5b5f7-dd61-4783-962d-7f36f6682527" released by "delete_volume" :: held 0.735s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Created reservations ['086bad5a-a3ba-48ef-83ed-ba46137275d0', 'd4d70bd9-7f0a-4138-99e8-29995ee25673', '9d7cc0a8-9284-413e-bc8c-9ad8fef78e83', '41f57ff2-38b0-4634-b251-3797366f69a3'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:41 devstack sudo[114416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:41 devstack sudo[114416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Acquiring lock "cinder-4c8622e1-0d36-47ff-be9f-11141b3371e8-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Lock "cinder-4c8622e1-0d36-47ff-be9f-11141b3371e8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Flow 'volume_create_manager' (a98dadc7-9d16-4266-865e-3c5e795eecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aec9886-64ce-4afc-94cc-32cb67bd4758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aec9886-64ce-4afc-94cc-32cb67bd4758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1725724776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ede9b2-f000-476e-8967-2e3c82697617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477fe42286004bd5b9a4ac06b4e4b83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:42Z,use_quota=True,user_id='78d4b2aee4164822be94e291c76acfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf8e147-51de-495a-b435-d38362ad28c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf8e147-51de-495a-b435-d38362ad28c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:41 devstack sudo[114416]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496b9c23-a2d1-4374-bef2-c3f637b67016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496b9c23-a2d1-4374-bef2-c3f637b67016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ede9b2-f000-476e-8967-2e3c82697617', 'volume_name': 'volume-62ede9b2-f000-476e-8967-2e3c82697617', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99862a42-1d1b-413e-a2dc-1edb59582e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99862a42-1d1b-413e-a2dc-1edb59582e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fe4d35-56ca-4000-8879-81a0648de719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:41 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume 62ede9b2-f000-476e-8967-2e3c82697617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ede9b2-f000-476e-8967-2e3c82697617', 'volume_size': 1}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1725724776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ede9b2-f000-476e-8967-2e3c82697617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477fe42286004bd5b9a4ac06b4e4b83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:42Z,use_quota=True,user_id='78d4b2aee4164822be94e291c76acfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Creating volume 62ede9b2-f000-476e-8967-2e3c82697617 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:41 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62ede9b2-f000-476e-8967-2e3c82697617 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.524s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:41 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:41 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Deleted volume successfully.
Aug 26 17:24:42 devstack sudo[114419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62ede9b2-f000-476e-8967-2e3c82697617 1073741824
Aug 26 17:24:42 devstack sudo[114419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Acquiring lock "cinder-quobyte-4c8622e1-0d36-47ff-be9f-11141b3371e8" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e21bc37d-5182-4430-845f-d359d5fb15de tempest-CinderUnicodeTest-278837014 None] Lock "cinder-4ce5b5f7-dd61-4783-962d-7f36f6682527-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Lock "cinder-quobyte-4c8622e1-0d36-47ff-be9f-11141b3371e8" acquired by "delete_volume" :: waited 0.022s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aea35a7-1700-4817-a432-b66dd072c405]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c8622e1-0d36-47ff-be9f-11141b3371e8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:42 devstack sudo[114421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c8622e1-0d36-47ff-be9f-11141b3371e8
Aug 26 17:24:42 devstack sudo[114421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:42 devstack sudo[114422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:42 devstack sudo[114422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Flow 'volume_create_manager' (f098f9db-4fee-4461-929d-89d4eca8fb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5a949d-7b73-4970-b02c-b4b527f5a90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5a949d-7b73-4970-b02c-b4b527f5a90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847625164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560d903a-113f-4c3d-b739-ed2a19616ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477fe42286004bd5b9a4ac06b4e4b83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:42Z,use_quota=True,user_id='78d4b2aee4164822be94e291c76acfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f054dd6-f5fc-4ff7-9bf4-2c2b33466f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f054dd6-f5fc-4ff7-9bf4-2c2b33466f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:42 devstack sudo[114422]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ff26e9-28ec-4ffa-a6c9-70c61e5ede81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ff26e9-28ec-4ffa-a6c9-70c61e5ede81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '560d903a-113f-4c3d-b739-ed2a19616ac3', 'volume_name': 'volume-560d903a-113f-4c3d-b739-ed2a19616ac3', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011978a1-aaad-4c0d-9d41-d6f4c8a2c164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011978a1-aaad-4c0d-9d41-d6f4c8a2c164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac43b0a-1a3a-4aff-88d8-65b6803ea06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:42 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume 560d903a-113f-4c3d-b739-ed2a19616ac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-560d903a-113f-4c3d-b739-ed2a19616ac3', 'volume_size': 1}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.481s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 29 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>, <Thread(Rabbit-heartbeat, started daemon 133049442341056)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:24:42 devstack sudo[114419]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62ede9b2-f000-476e-8967-2e3c82697617 1073741824" returned: 0 in 0.807s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62ede9b2-f000-476e-8967-2e3c82697617 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:42 devstack sudo[114421]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c8622e1-0d36-47ff-be9f-11141b3371e8" returned: 0 in 0.758s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c8622e1-0d36-47ff-be9f-11141b3371e8 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:42 devstack sudo[114432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62ede9b2-f000-476e-8967-2e3c82697617
Aug 26 17:24:42 devstack sudo[114432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:42 devstack sudo[114434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c8622e1-0d36-47ff-be9f-11141b3371e8
Aug 26 17:24:42 devstack sudo[114434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:42 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Flow 'volume_create_manager' (678876bf-664e-46eb-883b-06ff312f896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5418d5aa-761d-4a94-b5f5-b8aa2d3ec83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5418d5aa-761d-4a94-b5f5-b8aa2d3ec83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1573082951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5fd41d-6c4d-40fd-a8f9-22679cf25d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477fe42286004bd5b9a4ac06b4e4b83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:43Z,use_quota=True,user_id='78d4b2aee4164822be94e291c76acfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b167789-c34b-4ad7-b64c-a2671ce39f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b167789-c34b-4ad7-b64c-a2671ce39f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc480d5d-22c9-43c5-8d8d-f2350c6b572a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc480d5d-22c9-43c5-8d8d-f2350c6b572a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5fd41d-6c4d-40fd-a8f9-22679cf25d57', 'volume_name': 'volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3a27f8-8de6-446d-9265-52456403835f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3a27f8-8de6-446d-9265-52456403835f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96652e3a-00ed-4c02-8338-c084cee4eea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:43 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume da5fd41d-6c4d-40fd-a8f9-22679cf25d57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57', 'volume_size': 1}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:43 devstack sudo[114432]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62ede9b2-f000-476e-8967-2e3c82697617" returned: 0 in 0.359s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.505s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:43 devstack sudo[114434]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847625164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560d903a-113f-4c3d-b739-ed2a19616ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477fe42286004bd5b9a4ac06b4e4b83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:42Z,use_quota=True,user_id='78d4b2aee4164822be94e291c76acfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Creating volume 560d903a-113f-4c3d-b739-ed2a19616ac3 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:43 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-560d903a-113f-4c3d-b739-ed2a19616ac3 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4c8622e1-0d36-47ff-be9f-11141b3371e8" returned: 0 in 0.388s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:43 devstack sudo[114438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-560d903a-113f-4c3d-b739-ed2a19616ac3 1073741824
Aug 26 17:24:43 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fe4d35-56ca-4000-8879-81a0648de719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ede9b2-f000-476e-8967-2e3c82697617', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c57b81b-a5b8-4c48-89fb-40563385288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Lock "cinder-quobyte-4c8622e1-0d36-47ff-be9f-11141b3371e8" released by "delete_volume" :: held 1.257s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:43 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume volume-62ede9b2-f000-476e-8967-2e3c82697617 (62ede9b2-f000-476e-8967-2e3c82697617): created successfully
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c57b81b-a5b8-4c48-89fb-40563385288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Flow 'volume_create_manager' (a98dadc7-9d16-4266-865e-3c5e795eecc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:43 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4611b01d-efb2-44e1-8512-b1a18cccabb7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Created volume successfully.
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Created reservations ['6b6e4610-7785-40dd-826d-bb1132682678', '14ccb318-bbce-4093-9b12-7527d0d1bc66', 'acde3c6c-0c9c-40ae-ace1-3f03427057be', '39cddf40-3783-4379-9037-e8a314060c56'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:43 devstack sudo[114444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:43 devstack sudo[114444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Flow 'volume_create_manager' (3acd8cb4-4dd7-4916-b47f-ddf8304ca5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a80d1fe-c154-49f1-9fa2-d651f8e3bd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a80d1fe-c154-49f1-9fa2-d651f8e3bd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-42274560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4aa6c1-46b1-4279-ba98-f686106d2e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477fe42286004bd5b9a4ac06b4e4b83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:44Z,use_quota=True,user_id='78d4b2aee4164822be94e291c76acfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cd229b-08e4-4041-8c2a-00e032cb408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cd229b-08e4-4041-8c2a-00e032cb408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:43 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29cab92-06c1-4444-86f3-a0a81d04d4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29cab92-06c1-4444-86f3-a0a81d04d4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4aa6c1-46b1-4279-ba98-f686106d2e55', 'volume_name': 'volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262e37d7-64fa-4772-81cd-45c86486f13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262e37d7-64fa-4772-81cd-45c86486f13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e33623-6cbd-4b73-863f-e9cf915259fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:43 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume 5c4aa6c1-46b1-4279-ba98-f686106d2e55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55', 'volume_size': 1}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-560d903a-113f-4c3d-b739-ed2a19616ac3 1073741824" returned: 0 in 0.771s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-560d903a-113f-4c3d-b739-ed2a19616ac3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:44 devstack sudo[114444]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.394s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Deleted volume successfully.
Aug 26 17:24:44 devstack sudo[114447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-560d903a-113f-4c3d-b739-ed2a19616ac3
Aug 26 17:24:44 devstack sudo[114447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-49da8086-3aed-4555-a1ce-71918f2a13e7 tempest-CinderUnicodeTest-278837014 None] Lock "cinder-4c8622e1-0d36-47ff-be9f-11141b3371e8-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:44 devstack sudo[114447]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-560d903a-113f-4c3d-b739-ed2a19616ac3" returned: 0 in 0.389s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.348s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1573082951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5fd41d-6c4d-40fd-a8f9-22679cf25d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477fe42286004bd5b9a4ac06b4e4b83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:43Z,use_quota=True,user_id='78d4b2aee4164822be94e291c76acfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Creating volume da5fd41d-6c4d-40fd-a8f9-22679cf25d57 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:44 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac43b0a-1a3a-4aff-88d8-65b6803ea06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-560d903a-113f-4c3d-b739-ed2a19616ac3', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be8db15-6ce5-4be2-a3a5-805de22cd0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:44 devstack sudo[114450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57 1073741824
Aug 26 17:24:44 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:44 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume volume-560d903a-113f-4c3d-b739-ed2a19616ac3 (560d903a-113f-4c3d-b739-ed2a19616ac3): created successfully
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be8db15-6ce5-4be2-a3a5-805de22cd0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Flow 'volume_create_manager' (f098f9db-4fee-4461-929d-89d4eca8fb50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Flow 'volume_create_manager' (ce110b9f-7afc-4cc0-8831-91c59657a32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf005bf1-153f-4060-a0fa-09aae1603490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-af4dc747-3797-45c2-84b8-f71f4ca5b2a7 tempest-CreateVolumesFromSnapshotTest-43488183 None] Created volume successfully.
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf005bf1-153f-4060-a0fa-09aae1603490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-22354166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db4dd36-0f4c-4d8e-8364-aa9539f4901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477fe42286004bd5b9a4ac06b4e4b83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:44Z,use_quota=True,user_id='78d4b2aee4164822be94e291c76acfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc39af59-42e0-4f68-923c-548203db9136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc39af59-42e0-4f68-923c-548203db9136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f433624-cfeb-4461-802d-4fad1e0e942e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f433624-cfeb-4461-802d-4fad1e0e942e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db4dd36-0f4c-4d8e-8364-aa9539f4901e', 'volume_name': 'volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0be41cc-3285-4b45-adba-5c1b18138297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0be41cc-3285-4b45-adba-5c1b18138297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050cb23a-138a-4085-930c-24f5116f208f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:44 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume 7db4dd36-0f4c-4d8e-8364-aa9539f4901e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e', 'volume_size': 1}
Aug 26 17:24:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:45 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57 1073741824" returned: 0 in 0.646s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:45 devstack sudo[114456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57
Aug 26 17:24:45 devstack sudo[114456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Flow 'volume_create_manager' (7e4faec9-bde4-41de-aad3-1aa363f3d05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11394a13-ff3b-483b-9f95-3245947d7fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11394a13-ff3b-483b-9f95-3245947d7fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3084770-c15d-40c7-ae9d-b36a7bfa00bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279ffa8cfab84d39b31c7627581e3cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:45Z,use_quota=True,user_id='80ac4f56632843719cfb0da963783be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f42507-82ee-456f-8acb-df9454876bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f42507-82ee-456f-8acb-df9454876bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31fcc683-9639-473e-8183-4749afd4997e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.image.glance [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Creating Keystone auth plugin from conf {{(pid=94125) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 17:24:45 devstack sudo[114456]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57" returned: 0 in 0.348s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-42274560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4aa6c1-46b1-4279-ba98-f686106d2e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477fe42286004bd5b9a4ac06b4e4b83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:44Z,use_quota=True,user_id='78d4b2aee4164822be94e291c76acfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Creating volume 5c4aa6c1-46b1-4279-ba98-f686106d2e55 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:45 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96652e3a-00ed-4c02-8338-c084cee4eea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:45 devstack sudo[114459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55 1073741824
Aug 26 17:24:45 devstack sudo[114459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d3df0d-4937-4b6a-9485-b1688ac726a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:45 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57 (da5fd41d-6c4d-40fd-a8f9-22679cf25d57): created successfully
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d3df0d-4937-4b6a-9485-b1688ac726a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Flow 'volume_create_manager' (678876bf-664e-46eb-883b-06ff312f896b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-407b70e4-57e1-43ec-b818-98dc3b146068 tempest-CreateVolumesFromSnapshotTest-43488183 None] Created volume successfully.
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31fcc683-9639-473e-8183-4749afd4997e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3084770-c15d-40c7-ae9d-b36a7bfa00bd', 'volume_name': 'volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd', 'volume_size': 1, 'image_id': 'd566d39c-8596-4244-ae28-e5b77239e08e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d566d39c-8596-4244-ae28-e5b77239e08e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9e0c03ea1f9161a7534021d911d2916', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '279ffa8cfab84d39b31c7627581e3cb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f69237a981d8911a1906d52c6ec8cdb11fe4556ecf6760534fa03699afbc0c7a233f84720250e18a9e17caf2e82314e8c73b56827e71ce6947fd0e0a85f6dcc5', 'id': 'd566d39c-8596-4244-ae28-e5b77239e08e', 'created_at': datetime.datetime(2026, 8, 26, 15, 24, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 24, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d566d39c-8596-4244-ae28-e5b77239e08e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901f2778740>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8417b707-02f2-4dc1-80bf-c3fdbdf8b2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8417b707-02f2-4dc1-80bf-c3fdbdf8b2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409ecd41-3a82-45cd-a896-7fd029fb2f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:46 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Volume d3084770-c15d-40c7-ae9d-b36a7bfa00bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd', 'volume_size': 1, 'image_id': 'd566d39c-8596-4244-ae28-e5b77239e08e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d566d39c-8596-4244-ae28-e5b77239e08e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9e0c03ea1f9161a7534021d911d2916', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '279ffa8cfab84d39b31c7627581e3cb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f69237a981d8911a1906d52c6ec8cdb11fe4556ecf6760534fa03699afbc0c7a233f84720250e18a9e17caf2e82314e8c73b56827e71ce6947fd0e0a85f6dcc5', 'id': 'd566d39c-8596-4244-ae28-e5b77239e08e', 'created_at': datetime.datetime(2026, 8, 26, 15, 24, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 24, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d566d39c-8596-4244-ae28-e5b77239e08e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901f2778740>}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Trying to clone d3084770-c15d-40c7-ae9d-b36a7bfa00bd from image d566d39c-8596-4244-ae28-e5b77239e08e at location (None, [{'url': 'file:///opt/stack/data/glance/images/d566d39c-8596-4244-ae28-e5b77239e08e', 'metadata': {}}]). {{(pid=94125) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 17:24:46 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Image download 0.00 MB at 0.00 MB/s
Aug 26 17:24:46 devstack sudo[114459]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55 1073741824" returned: 0 in 0.667s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5b9884-c0fe-422a-a56a-360e5c82f9e1]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:46 devstack sudo[114466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55
Aug 26 17:24:46 devstack sudo[114466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:46 devstack sudo[114465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD
Aug 26 17:24:46 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:46 devstack sudo[114466]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55" returned: 0 in 0.357s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.996s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-22354166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db4dd36-0f4c-4d8e-8364-aa9539f4901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477fe42286004bd5b9a4ac06b4e4b83b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:44Z,use_quota=True,user_id='78d4b2aee4164822be94e291c76acfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Creating volume 7db4dd36-0f4c-4d8e-8364-aa9539f4901e {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:46 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:46 devstack sudo[114471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e 1073741824
Aug 26 17:24:46 devstack sudo[114471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e33623-6cbd-4b73-863f-e9cf915259fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99818a24-f0bf-45da-8895-4650b6ffaf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:46 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55 (5c4aa6c1-46b1-4279-ba98-f686106d2e55): created successfully
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99818a24-f0bf-45da-8895-4650b6ffaf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:46 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Flow 'volume_create_manager' (3acd8cb4-4dd7-4916-b47f-ddf8304ca5f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD" returned: 0 in 0.497s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:46 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-54fce6fa-14fa-4e6f-a18b-d2a845890444 tempest-CreateVolumesFromSnapshotTest-43488183 None] Created volume successfully.
Aug 26 17:24:46 devstack sudo[114475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD
Aug 26 17:24:46 devstack sudo[114475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:47 devstack sudo[114475]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD" returned: 1 in 0.388s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Temporary image d566d39c-8596-4244-ae28-e5b77239e08e is fetched for user 80ac4f56632843719cfb0da963783be3. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 17:24:47 devstack sudo[114471]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e 1073741824" returned: 0 in 0.494s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:47 devstack sudo[114483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e
Aug 26 17:24:47 devstack sudo[114483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bd59f6-cd79-45c8-a155-0eea686ac392]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:47 devstack sudo[114485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD
Aug 26 17:24:47 devstack sudo[114485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:47 devstack sudo[114483]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e" returned: 0 in 0.368s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050cb23a-138a-4085-930c-24f5116f208f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa09828e-83c5-4de6-9c86-526139836229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:47 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Volume volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e (7db4dd36-0f4c-4d8e-8364-aa9539f4901e): created successfully
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa09828e-83c5-4de6-9c86-526139836229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Flow 'volume_create_manager' (ce110b9f-7afc-4cc0-8831-91c59657a32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:47 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-3e6ba4ea-c4ef-43c2-97b4-ea109c090b82 tempest-CreateVolumesFromSnapshotTest-43488183 None] Created volume successfully.
Aug 26 17:24:47 devstack sudo[114485]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-7db4dd36-0f4c-4d8e-8364-aa9539f4901e-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-7db4dd36-0f4c-4d8e-8364-aa9539f4901e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-quobyte-7db4dd36-0f4c-4d8e-8364-aa9539f4901e" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-7db4dd36-0f4c-4d8e-8364-aa9539f4901e" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:47 devstack sudo[114490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD
Aug 26 17:24:47 devstack sudo[114490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc1648b-4a85-48f8-8eab-753c53b69903]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:48 devstack sudo[114492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e
Aug 26 17:24:48 devstack sudo[114492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:48 devstack sudo[114490]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD" returned: 1 in 0.452s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3084770-c15d-40c7-ae9d-b36a7bfa00bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279ffa8cfab84d39b31c7627581e3cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:45Z,use_quota=True,user_id='80ac4f56632843719cfb0da963783be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Creating volume d3084770-c15d-40c7-ae9d-b36a7bfa00bd {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:48 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:48 devstack sudo[114497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd 1073741824
Aug 26 17:24:48 devstack sudo[114497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:48 devstack sudo[114492]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e" returned: 0 in 0.430s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:48 devstack sudo[114502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e
Aug 26 17:24:48 devstack sudo[114502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:48 devstack sudo[114502]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-7db4dd36-0f4c-4d8e-8364-aa9539f4901e" returned: 0 in 0.292s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-7db4dd36-0f4c-4d8e-8364-aa9539f4901e" released by "delete_volume" :: held 0.795s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Created reservations ['85225f3f-a275-4a65-96ac-7b390dc236f3', '6a067198-2bc0-42ab-9f28-f0751f028481', '6539bb4f-9f7c-4a92-926b-22850ec7533d', '5f137d90-a6b3-45a1-b880-a4a2591c828f'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:48 devstack sudo[114497]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd 1073741824" returned: 0 in 0.614s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:48 devstack sudo[114509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd
Aug 26 17:24:48 devstack sudo[114509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:49 devstack sudo[114511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:49 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-5c4aa6c1-46b1-4279-ba98-f686106d2e55-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-5c4aa6c1-46b1-4279-ba98-f686106d2e55-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (87b12595-356f-4a05-8ba2-7cfa8110a0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec05029-b245-4047-892c-6d216dc72ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-quobyte-5c4aa6c1-46b1-4279-ba98-f686106d2e55" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec05029-b245-4047-892c-6d216dc72ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-152786127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c9a519-4c11-4951-a616-b16e713564be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:49Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e058584a-0833-4f64-b040-a87e6be385cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e058584a-0833-4f64-b040-a87e6be385cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a308f4a-27d7-4c55-a6ca-6a2f8e74ea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a308f4a-27d7-4c55-a6ca-6a2f8e74ea3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82c9a519-4c11-4951-a616-b16e713564be', 'volume_name': 'volume-82c9a519-4c11-4951-a616-b16e713564be', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d21971-5bbd-440d-a58c-bf69a6e20978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d21971-5bbd-440d-a58c-bf69a6e20978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:49 devstack sudo[114509]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df66fda4-b91e-4960-a8f6-3ce35a98cf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:49 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Volume 82c9a519-4c11-4951-a616-b16e713564be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82c9a519-4c11-4951-a616-b16e713564be', 'volume_size': 1}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd" returned: 0 in 0.409s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-152786127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c9a519-4c11-4951-a616-b16e713564be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:24:49Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Creating volume 82c9a519-4c11-4951-a616-b16e713564be {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:24:49 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-5c4aa6c1-46b1-4279-ba98-f686106d2e55" acquired by "delete_volume" :: waited 0.083s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:49 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.388s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:49 devstack sudo[114515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be 1073741824
Aug 26 17:24:49 devstack sudo[114515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:49 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Deleted volume successfully.
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fdb658-c643-4b3f-8974-908d72489029]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Attempting download of d566d39c-8596-4244-ae28-e5b77239e08e ((None, [{'url': 'file:///opt/stack/data/glance/images/d566d39c-8596-4244-ae28-e5b77239e08e', 'metadata': {}}])) to volume d3084770-c15d-40c7-ae9d-b36a7bfa00bd. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-14f34d62-b941-4165-90c7-2a3d0db42045 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-7db4dd36-0f4c-4d8e-8364-aa9539f4901e-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac403ebe-2cf0-467c-a27d-a6f07827e346]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d566d39c-8596-4244-ae28-e5b77239e08e_at1x5wxk {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:49 devstack sudo[114517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55
Aug 26 17:24:49 devstack sudo[114517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:49 devstack sudo[114518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d566d39c-8596-4244-ae28-e5b77239e08e_at1x5wxk
Aug 26 17:24:49 devstack sudo[114518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:49 devstack sudo[114518]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d566d39c-8596-4244-ae28-e5b77239e08e_at1x5wxk" returned: 0 in 0.386s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d566d39c-8596-4244-ae28-e5b77239e08e_at1x5wxk {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:49 devstack sudo[114515]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be 1073741824" returned: 0 in 0.587s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:49 devstack sudo[114517]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55" returned: 0 in 0.536s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:50 devstack sudo[114534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55
Aug 26 17:24:50 devstack sudo[114534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:50 devstack sudo[114536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be
Aug 26 17:24:50 devstack sudo[114536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:50 devstack sudo[114533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d566d39c-8596-4244-ae28-e5b77239e08e_at1x5wxk
Aug 26 17:24:50 devstack sudo[114533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:50 devstack sudo[114534]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5c4aa6c1-46b1-4279-ba98-f686106d2e55" returned: 0 in 0.304s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-5c4aa6c1-46b1-4279-ba98-f686106d2e55" released by "delete_volume" :: held 0.908s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:50 devstack sudo[114536]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be" returned: 0 in 0.301s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df66fda4-b91e-4960-a8f6-3ce35a98cf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c9a519-4c11-4951-a616-b16e713564be', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:50 devstack sudo[114533]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1821ca9c-f65c-47ea-9c10-33b3b9946856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d566d39c-8596-4244-ae28-e5b77239e08e_at1x5wxk" returned: 1 in 0.408s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d566d39c-8596-4244-ae28-e5b77239e08e_at1x5wxk' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[850bf24a-bff1-4621-a4dc-3e61fdf3a674]: (4, 'raw') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:50 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Volume volume-82c9a519-4c11-4951-a616-b16e713564be (82c9a519-4c11-4951-a616-b16e713564be): created successfully
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1821ca9c-f65c-47ea-9c10-33b3b9946856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (87b12595-356f-4a05-8ba2-7cfa8110a0ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:50 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-98d4db30-2b87-46ac-8ed4-87f7fe54803e tempest-ProjectMemberTests-2141364931 None] Created volume successfully.
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Created reservations ['9c8539ff-9dfd-4eaf-b62d-da24b8972527', '13e0338a-b8fd-45c5-b1b1-f4b0e4df2a62', '6cd86ed7-2dcb-4fa5-ae0f-1553c5fcec64', '6a8661f4-3346-4530-80b8-ef06059ab9df'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:50 devstack sudo[114543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD
Aug 26 17:24:50 devstack sudo[114543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:50 devstack sudo[114545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:50 devstack sudo[114545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:50 devstack sudo[114543]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:50 devstack sudo[114545]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.247s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:50 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Deleted volume successfully.
Aug 26 17:24:50 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ac36c830-0b20-43ca-be10-f42347be6e7b tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-5c4aa6c1-46b1-4279-ba98-f686106d2e55-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:50 devstack sudo[114550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD
Aug 26 17:24:50 devstack sudo[114550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:51 devstack sudo[114550]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD" returned: 1 in 0.350s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD' failed. Not Retrying. {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] d566d39c-8596-4244-ae28-e5b77239e08e was raw, converting to qcow2 {{(pid=94125) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:51 devstack sudo[114555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd
Aug 26 17:24:51 devstack sudo[114555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-da5fd41d-6c4d-40fd-a8f9-22679cf25d57-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-da5fd41d-6c4d-40fd-a8f9-22679cf25d57-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-quobyte-da5fd41d-6c4d-40fd-a8f9-22679cf25d57" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-da5fd41d-6c4d-40fd-a8f9-22679cf25d57" acquired by "delete_volume" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:51 devstack sudo[114555]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd" returned: 0 in 0.545s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d566d39c-8596-4244-ae28-e5b77239e08e_zuslivb5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:24:51 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Converted 0.00 MB image at 0.00 MB/s
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ce3e91-aa62-4a64-b2bc-25815b7721e6]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:51 devstack sudo[114561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd 1G
Aug 26 17:24:51 devstack sudo[114561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] Creating offline snapshot 5e72577c-9ddc-4090-b130-10248485a6f3 of volume 82c9a519-4c11-4951-a616-b16e713564be {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d81e4a-a9c1-4264-9841-2f8632362c7f]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:51 devstack sudo[114562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57
Aug 26 17:24:51 devstack sudo[114562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:51 devstack sudo[114564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be
Aug 26 17:24:51 devstack sudo[114564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:52 devstack sudo[114561]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd 1G" returned: 0 in 0.391s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Downloaded image d566d39c-8596-4244-ae28-e5b77239e08e ((None, [{'url': 'file:///opt/stack/data/glance/images/d566d39c-8596-4244-ae28-e5b77239e08e', 'metadata': {}}])) to volume d3084770-c15d-40c7-ae9d-b36a7bfa00bd successfully. {{(pid=94125) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Temporary image d566d39c-8596-4244-ae28-e5b77239e08e for user 80ac4f56632843719cfb0da963783be3 is deleted. {{(pid=94125) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.volume.volume_utils [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Marking volume d3084770-c15d-40c7-ae9d-b36a7bfa00bd as bootable. {{(pid=94125) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Copying metadata from image d566d39c-8596-4244-ae28-e5b77239e08e to d3084770-c15d-40c7-ae9d-b36a7bfa00bd. {{(pid=94125) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Creating volume glance metadata for volume d3084770-c15d-40c7-ae9d-b36a7bfa00bd backed by image d566d39c-8596-4244-ae28-e5b77239e08e with: {'image_id': 'd566d39c-8596-4244-ae28-e5b77239e08e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c9e0c03ea1f9161a7534021d911d2916', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94125) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409ecd41-3a82-45cd-a896-7fd029fb2f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd', 'volume_size': 1, 'image_id': 'd566d39c-8596-4244-ae28-e5b77239e08e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d566d39c-8596-4244-ae28-e5b77239e08e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9e0c03ea1f9161a7534021d911d2916', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '279ffa8cfab84d39b31c7627581e3cb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f69237a981d8911a1906d52c6ec8cdb11fe4556ecf6760534fa03699afbc0c7a233f84720250e18a9e17caf2e82314e8c73b56827e71ce6947fd0e0a85f6dcc5', 'id': 'd566d39c-8596-4244-ae28-e5b77239e08e', 'created_at': datetime.datetime(2026, 8, 26, 15, 24, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 15, 24, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d566d39c-8596-4244-ae28-e5b77239e08e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7901f2778740>}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a72a91-2c3b-4c3e-b9a7-e64296e4253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:24:52 devstack sudo[114562]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57" returned: 0 in 0.486s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:52 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Volume volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd (d3084770-c15d-40c7-ae9d-b36a7bfa00bd): created successfully
Aug 26 17:24:52 devstack sudo[114574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57
Aug 26 17:24:52 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a72a91-2c3b-4c3e-b9a7-e64296e4253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Flow 'volume_create_manager' (7e4faec9-bde4-41de-aad3-1aa363f3d05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:24:52 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1a9e767f-da61-4119-a706-505f70499f05 tempest-VolumeImageDependencyTests-1798113883 None] Created volume successfully.
Aug 26 17:24:52 devstack sudo[114564]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be" returned: 0 in 0.489s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:52 devstack sudo[114579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3 1G
Aug 26 17:24:52 devstack sudo[114579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:52 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-da5fd41d-6c4d-40fd-a8f9-22679cf25d57" returned: 0 in 0.296s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-da5fd41d-6c4d-40fd-a8f9-22679cf25d57" released by "delete_volume" :: held 0.875s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Created reservations ['c6e5d01b-7305-4033-8c60-481d1a1595a1', '3bd6938c-0b8e-40f2-b601-0f683ca1d17e', 'eac98aaa-35cc-4bbb-92b0-7ac7e1076587', '7e8209bd-e23a-4944-9d94-62f08a45e3fd'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:52 devstack sudo[114585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:52 devstack sudo[114585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:52 devstack sudo[114579]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3 1G" returned: 0 in 0.569s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82c9a519-4c11-4951-a616-b16e713564be -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-560d903a-113f-4c3d-b739-ed2a19616ac3-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:52 devstack sudo[114587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82c9a519-4c11-4951-a616-b16e713564be -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Acquiring lock "cinder-d3084770-c15d-40c7-ae9d-b36a7bfa00bd-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:52 devstack sudo[114587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-560d903a-113f-4c3d-b739-ed2a19616ac3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Lock "cinder-d3084770-c15d-40c7-ae9d-b36a7bfa00bd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Acquiring lock "cinder-quobyte-d3084770-c15d-40c7-ae9d-b36a7bfa00bd" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-quobyte-560d903a-113f-4c3d-b739-ed2a19616ac3" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-560d903a-113f-4c3d-b739-ed2a19616ac3" acquired by "delete_volume" :: waited 0.038s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:53 devstack sudo[114585]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Lock "cinder-quobyte-d3084770-c15d-40c7-ae9d-b36a7bfa00bd" acquired by "delete_volume" :: waited 0.068s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.376s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bdb886-2f91-409f-b097-d4c35bc61bff]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-560d903a-113f-4c3d-b739-ed2a19616ac3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a97ecd-256b-4dea-98c1-adcee8950dc7]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:53 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Deleted volume successfully.
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-317aa86f-28e3-4ac4-adfd-be7bcd3ae593 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-da5fd41d-6c4d-40fd-a8f9-22679cf25d57-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:53 devstack sudo[114587]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:53 devstack sudo[114592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd
Aug 26 17:24:53 devstack sudo[114592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82c9a519-4c11-4951-a616-b16e713564be -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3" returned: 0 in 0.407s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:53 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3 is being set with open permissions: ugo+rw
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:53 devstack sudo[114591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-560d903a-113f-4c3d-b739-ed2a19616ac3
Aug 26 17:24:53 devstack sudo[114591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:53 devstack sudo[114599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3
Aug 26 17:24:53 devstack sudo[114599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd" returned: 0 in 0.440s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3" returned: 0 in 0.362s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:53 devstack sudo[114592]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-560d903a-113f-4c3d-b739-ed2a19616ac3" returned: 0 in 0.558s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-560d903a-113f-4c3d-b739-ed2a19616ac3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:53 devstack sudo[114608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd
Aug 26 17:24:53 devstack sudo[114608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:53 devstack sudo[114599]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:53 devstack sudo[114591]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:53 devstack sudo[114611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-560d903a-113f-4c3d-b739-ed2a19616ac3
Aug 26 17:24:53 devstack sudo[114611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:53 devstack sudo[114614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.info
Aug 26 17:24:53 devstack sudo[114614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:53 devstack sudo[114608]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d3084770-c15d-40c7-ae9d-b36a7bfa00bd" returned: 0 in 0.414s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Lock "cinder-quobyte-d3084770-c15d-40c7-ae9d-b36a7bfa00bd" released by "delete_volume" :: held 0.930s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:54 devstack sudo[114611]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-560d903a-113f-4c3d-b739-ed2a19616ac3" returned: 0 in 0.385s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-560d903a-113f-4c3d-b739-ed2a19616ac3" released by "delete_volume" :: held 1.022s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Created reservations ['8a26121d-c650-4872-ae75-0a0da1c915af', '8b97021b-70b3-4809-8117-fd649ddcd1e6', '364fc3cf-037f-4ab0-85cd-aff830c65180', '3584b607-98a3-44fa-b3e8-8a456711e5e1'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Created reservations ['f8c2c771-3ae7-47b8-bb49-6ea88a385ffc', '0f061be4-f53b-469f-bd5e-a7c6be39a760', '7db1f1f0-5b8c-430d-b478-1b3c217659c4', '8b72bf49-50c5-46cb-a20e-38192884c1e1'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:54 devstack sudo[114614]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.info" returned: 0 in 0.468s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:54 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.info is being set with open permissions: ugo+rw
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:54 devstack sudo[114619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.info
Aug 26 17:24:54 devstack sudo[114619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:54 devstack sudo[114621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:54 devstack sudo[114621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:54 devstack sudo[114623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:54 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:54 devstack sudo[114619]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.info" returned: 0 in 0.278s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.731s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:54 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2a7006f3-dc87-46a5-a459-c506872993c0 tempest-ProjectMemberTests-2141364931 None] Create snapshot completed successfully
Aug 26 17:24:54 devstack sudo[114621]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.295s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:54 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Deleted volume successfully.
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-98f11e0a-e609-4a02-b1a8-ae5acc8fd158 tempest-VolumeImageDependencyTests-1798113883 None] Lock "cinder-d3084770-c15d-40c7-ae9d-b36a7bfa00bd-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:54 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.311s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:54 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Deleted volume successfully.
Aug 26 17:24:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-75f05568-466f-431c-b41f-72a95bf7b487 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-560d903a-113f-4c3d-b739-ed2a19616ac3-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-5e72577c-9ddc-4090-b130-10248485a6f3-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-5e72577c-9ddc-4090-b130-10248485a6f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-82c9a519-4c11-4951-a616-b16e713564be" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-82c9a519-4c11-4951-a616-b16e713564be" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-5e72577c-9ddc-4090-b130-10248485a6f3" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-5e72577c-9ddc-4090-b130-10248485a6f3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Deleting offline snapshot 5e72577c-9ddc-4090-b130-10248485a6f3 of volume 82c9a519-4c11-4951-a616-b16e713564be {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] snapshot_file for this snap is: volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[00db6a62-35d2-43f3-a27d-e23e3b3465aa]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-62ede9b2-f000-476e-8967-2e3c82697617-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-62ede9b2-f000-476e-8967-2e3c82697617-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:55 devstack sudo[114628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3
Aug 26 17:24:55 devstack sudo[114628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-quobyte-62ede9b2-f000-476e-8967-2e3c82697617" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-62ede9b2-f000-476e-8967-2e3c82697617" acquired by "delete_volume" :: waited 0.036s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fb7cd1-30fd-4912-bfd8-60676fb4fdc2]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62ede9b2-f000-476e-8967-2e3c82697617 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:55 devstack sudo[114630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62ede9b2-f000-476e-8967-2e3c82697617
Aug 26 17:24:55 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:55 devstack sudo[114628]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3" returned: 0 in 0.560s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82c9a519-4c11-4951-a616-b16e713564be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aea60f-bd82-4ddf-b6c1-b0829630ee4b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:55 devstack sudo[114636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be
Aug 26 17:24:55 devstack sudo[114636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:55 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62ede9b2-f000-476e-8967-2e3c82697617" returned: 0 in 0.480s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62ede9b2-f000-476e-8967-2e3c82697617 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:55 devstack sudo[114641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62ede9b2-f000-476e-8967-2e3c82697617
Aug 26 17:24:55 devstack sudo[114641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:56 devstack sudo[114636]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be" returned: 0 in 0.449s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:56 devstack sudo[114646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3
Aug 26 17:24:56 devstack sudo[114646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:56 devstack sudo[114641]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-62ede9b2-f000-476e-8967-2e3c82697617" returned: 0 in 0.353s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-62ede9b2-f000-476e-8967-2e3c82697617" released by "delete_volume" :: held 0.903s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Created reservations ['d00281d7-8a9b-4525-a67c-66eebf0e2ab1', 'e6bd2465-4cde-4692-b6f6-54c54bdfc9a7', 'f46b418c-8b82-4cff-9094-4ee920ebd27e', '1bd184fb-1280-48f0-96e4-ed42b0ade127'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:56 devstack sudo[114651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:56 devstack sudo[114651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:56 devstack sudo[114646]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3" returned: 0 in 0.542s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:56 devstack sudo[114656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3
Aug 26 17:24:56 devstack sudo[114656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:56 devstack sudo[114651]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.333s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:56 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Deleted volume successfully.
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d476870a-9443-4d53-826f-3310cfe594f2 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-62ede9b2-f000-476e-8967-2e3c82697617-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:56 devstack sudo[114656]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be.5e72577c-9ddc-4090-b130-10248485a6f3" returned: 0 in 0.305s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-5e72577c-9ddc-4090-b130-10248485a6f3" released by "_delete_snapshot" :: held 1.981s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-82c9a519-4c11-4951-a616-b16e713564be" released by "delete_snapshot" :: held 2.011s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Created reservations ['7c2f5720-cf63-4552-8fdc-ea5619aa7187', '414fe3be-e19d-45d9-a525-88a43dcc0b81', '8cf8af90-9266-4e64-97b9-4ebeb8921c64', '9b8c08ed-bc44-4a21-8cbd-ec36cffc5bd4'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:57 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Delete snapshot completed successfully.
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-58742485-3634-4758-9468-917d40a4e731 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-5e72577c-9ddc-4090-b130-10248485a6f3-delete_snapshot" released by "delete_snapshot" :: held 2.213s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-aad66fed-e6b2-4407-a786-8f4871496982-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-aad66fed-e6b2-4407-a786-8f4871496982-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-quobyte-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-quobyte-aad66fed-e6b2-4407-a786-8f4871496982" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-aad66fed-e6b2-4407-a786-8f4871496982" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Deleting offline snapshot aad66fed-e6b2-4407-a786-8f4871496982 of volume 76ef9d41-7f6a-40be-afd8-96bb51cf7f3e {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] snapshot_file for this snap is: volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[89393870-b5d6-426e-90ba-a46ce343b6d1]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:58 devstack sudo[114660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982
Aug 26 17:24:58 devstack sudo[114660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-82c9a519-4c11-4951-a616-b16e713564be-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-82c9a519-4c11-4951-a616-b16e713564be-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=207,cinder:INSERT=65,cinder:UPDATE=276,cinder:DELETE=30 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=272,cinder:SELECT=197,cinder:INSERT=82,cinder:DELETE=20 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-82c9a519-4c11-4951-a616-b16e713564be" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-82c9a519-4c11-4951-a616-b16e713564be" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:24:58 devstack sudo[114660]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982" returned: 0 in 0.515s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a7b72c-47b4-4b89-bb86-f7993e05d7f7]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5116c619-dc9a-48ef-b0e1-fdbbc4b264b0]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:58 devstack sudo[114665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be
Aug 26 17:24:58 devstack sudo[114665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:58 devstack sudo[114666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e
Aug 26 17:24:58 devstack sudo[114666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:58 devstack sudo[114666]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e" returned: 0 in 0.429s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:58 devstack sudo[114676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982
Aug 26 17:24:58 devstack sudo[114676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:58 devstack sudo[114665]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be" returned: 0 in 0.487s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:59 devstack sudo[114678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be
Aug 26 17:24:59 devstack sudo[114678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:59 devstack sudo[114678]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-82c9a519-4c11-4951-a616-b16e713564be" returned: 0 in 0.318s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-82c9a519-4c11-4951-a616-b16e713564be" released by "delete_volume" :: held 0.905s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:59 devstack sudo[114676]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982" returned: 0 in 0.454s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Created reservations ['feb290cb-8da5-4f5c-bd20-adb5bfbac992', 'd4b0b46d-9a47-4101-91ca-140b10e669fc', 'de1a7768-2a32-4487-a244-fd73c94f422c', '5cf68ed4-a363-429b-9cd4-97f40e1c6b6f'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:59 devstack sudo[114684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982
Aug 26 17:24:59 devstack sudo[114684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:24:59 devstack sudo[114686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:24:59 devstack sudo[114686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:24:59 devstack sudo[114684]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e.aad66fed-e6b2-4407-a786-8f4871496982" returned: 0 in 0.388s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:59 devstack sudo[114686]: pam_unix(sudo:session): session closed for user root
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.315s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-aad66fed-e6b2-4407-a786-8f4871496982" released by "_delete_snapshot" :: held 1.920s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:59 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Deleted volume successfully.
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e" released by "delete_snapshot" :: held 1.959s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-94f2892d-a3ea-4f10-98c8-5c72766b4963 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-82c9a519-4c11-4951-a616-b16e713564be-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:24:59 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Created reservations ['b45de9d7-6d52-4d26-aa10-62fc28034e0d', 'acc1fe85-3f31-4e9c-9863-9698677aa14a', '51eba666-b587-4857-bd60-b06ad1f900d6', '3d867fac-99fc-47ee-85e3-a1e5bc6c08a8'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:24:59 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Delete snapshot completed successfully.
Aug 26 17:25:00 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4ea51388-6669-4922-9ace-88d10ecc9514 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-aad66fed-e6b2-4407-a786-8f4871496982-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (f49564b2-b2fc-4e40-a8ea-cb6d0d3205c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961b0261-622a-4ca2-87ca-a898ed9da8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961b0261-622a-4ca2-87ca-a898ed9da8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035245311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ba5e5f-dfac-4680-a0b6-feb37c852fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:01Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8ee55d-e909-4bc3-b4e4-204eb21d60cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8ee55d-e909-4bc3-b4e4-204eb21d60cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d137bd-fe77-4f46-a921-0db0bcb142aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d137bd-fe77-4f46-a921-0db0bcb142aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ba5e5f-dfac-4680-a0b6-feb37c852fd7', 'volume_name': 'volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b92fab7-5d55-423d-b64c-5a0cf1328a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b92fab7-5d55-423d-b64c-5a0cf1328a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c61a4f-bc26-4c15-a434-b073f0ff7f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:01 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Volume 15ba5e5f-dfac-4680-a0b6-feb37c852fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7', 'volume_size': 1}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035245311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ba5e5f-dfac-4680-a0b6-feb37c852fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:01Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Creating volume 15ba5e5f-dfac-4680-a0b6-feb37c852fd7 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:01 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:01 devstack sudo[114694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7 1073741824
Aug 26 17:25:01 devstack sudo[114694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "cinder-quobyte-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[106e19bf-f6ea-45d3-abc5-4e7a8632a6ef]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:01 devstack sudo[114696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e
Aug 26 17:25:01 devstack sudo[114696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:01 devstack sudo[114694]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7 1073741824" returned: 0 in 0.693s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:02 devstack sudo[114696]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e" returned: 0 in 0.526s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:02 devstack sudo[114707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e
Aug 26 17:25:02 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:02 devstack sudo[114709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7
Aug 26 17:25:02 devstack sudo[114709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:02 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e" returned: 0 in 0.323s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-quobyte-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e" released by "delete_volume" :: held 0.937s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:02 devstack sudo[114709]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7" returned: 0 in 0.331s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c61a4f-bc26-4c15-a434-b073f0ff7f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b4e191-5a45-4752-8687-2d026789ddeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:02 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Volume volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7 (15ba5e5f-dfac-4680-a0b6-feb37c852fd7): created successfully
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b4e191-5a45-4752-8687-2d026789ddeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (f49564b2-b2fc-4e40-a8ea-cb6d0d3205c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:02 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c8e0290d-c831-43c0-99d2-62f401b86c98 tempest-ProjectMemberTests-2141364931 None] Created volume successfully.
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Created reservations ['4b3ef489-99ed-408f-bb78-1fca1ff832f6', '5784507a-c0e5-4b59-b06b-fecc244ca028', 'c3d666e0-6db6-4ec1-be58-8b375a747bf0', '0c4b805f-7ded-4445-a038-ecca94ad99d3'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:02 devstack sudo[114713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:02 devstack sudo[114713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:02 devstack sudo[114713]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.269s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:02 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Deleted volume successfully.
Aug 26 17:25:02 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8378dcd8-f959-4a1e-b99a-19be29749765 tempest-CreateVolumesFromSnapshotTest-43488183 None] Lock "cinder-76ef9d41-7f6a-40be-afd8-96bb51cf7f3e-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] Creating offline snapshot c05f7d71-6d74-41ec-87a6-5659dfad9bd6 of volume 15ba5e5f-dfac-4680-a0b6-feb37c852fd7 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:25:03 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[c661193f-5c96-4485-a3b6-56f30c81ca0e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:03 devstack sudo[114716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7
Aug 26 17:25:03 devstack sudo[114716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:03 devstack sudo[114716]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7" returned: 0 in 0.399s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:03 devstack sudo[114721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6 1G
Aug 26 17:25:03 devstack sudo[114721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:04 devstack sudo[114721]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6 1G" returned: 0 in 0.500s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:04 devstack sudo[114727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6
Aug 26 17:25:04 devstack sudo[114727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Flow 'volume_create_manager' (634d379f-d455-4f77-9729-7a7762b763cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8be003-59fd-4df0-9b90-198f9d45a540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8be003-59fd-4df0-9b90-198f9d45a540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123920654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3762b4-35cb-4bda-bb99-e40b7ca87c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2980034fdc1b4e62a5cdd939bf39591c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:04Z,use_quota=True,user_id='4ad72a5b96904f6c9d622bc1d770404a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703b2b73-0a41-4dcb-8c58-54940a26dc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703b2b73-0a41-4dcb-8c58-54940a26dc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06455269-2b4c-49d3-9a5b-eee1c3e5a700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06455269-2b4c-49d3-9a5b-eee1c3e5a700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3762b4-35cb-4bda-bb99-e40b7ca87c1b', 'volume_name': 'volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c21028-d56d-4547-a7c1-d9d637de7b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c21028-d56d-4547-a7c1-d9d637de7b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590d9543-808f-4443-ad41-5a56ed2008bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:04 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Volume ec3762b4-35cb-4bda-bb99-e40b7ca87c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b', 'volume_size': 1}
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:04 devstack sudo[114727]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6" returned: 0 in 0.389s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:04 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6 is being set with open permissions: ugo+rw
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:04 devstack sudo[114732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6
Aug 26 17:25:04 devstack sudo[114732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:04 devstack sudo[114732]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6" returned: 0 in 0.261s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:05 devstack sudo[114735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.info
Aug 26 17:25:05 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:05 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.info" returned: 0 in 0.276s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:05 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.info is being set with open permissions: ugo+rw
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:05 devstack sudo[114738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.info
Aug 26 17:25:05 devstack sudo[114738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:05 devstack sudo[114738]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.info" returned: 0 in 0.308s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.954s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123920654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3762b4-35cb-4bda-bb99-e40b7ca87c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2980034fdc1b4e62a5cdd939bf39591c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:04Z,use_quota=True,user_id='4ad72a5b96904f6c9d622bc1d770404a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Creating volume ec3762b4-35cb-4bda-bb99-e40b7ca87c1b {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:05 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:05 devstack sudo[114741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b 1073741824
Aug 26 17:25:05 devstack sudo[114741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:05 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c2e6bce3-0206-4678-a77e-16036d92835e tempest-ProjectMemberTests-2141364931 None] Create snapshot completed successfully
Aug 26 17:25:06 devstack sudo[114741]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b 1073741824" returned: 0 in 0.508s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:06 devstack sudo[114747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b
Aug 26 17:25:06 devstack sudo[114747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:06 devstack sudo[114747]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b" returned: 0 in 0.287s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590d9543-808f-4443-ad41-5a56ed2008bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d986a623-7680-4035-a4e4-a7bf013c887c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:06 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Volume volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b (ec3762b4-35cb-4bda-bb99-e40b7ca87c1b): created successfully
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d986a623-7680-4035-a4e4-a7bf013c887c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Flow 'volume_create_manager' (634d379f-d455-4f77-9729-7a7762b763cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:06 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-32c16a55-754b-4fca-a412-4f60d4cf9e3a tempest-ProjectReaderTests-1855211133 None] Created volume successfully.
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-c05f7d71-6d74-41ec-87a6-5659dfad9bd6-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-c05f7d71-6d74-41ec-87a6-5659dfad9bd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-15ba5e5f-dfac-4680-a0b6-feb37c852fd7" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-15ba5e5f-dfac-4680-a0b6-feb37c852fd7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-c05f7d71-6d74-41ec-87a6-5659dfad9bd6" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-c05f7d71-6d74-41ec-87a6-5659dfad9bd6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Deleting offline snapshot c05f7d71-6d74-41ec-87a6-5659dfad9bd6 of volume 15ba5e5f-dfac-4680-a0b6-feb37c852fd7 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] snapshot_file for this snap is: volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe51808-a4f2-4ef1-9db2-d66e31aa5e83]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:06 devstack sudo[114751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6
Aug 26 17:25:06 devstack sudo[114751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:07 devstack sudo[114751]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6" returned: 0 in 0.396s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:07 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:25:07 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8b5dff-4352-47d7-9834-029aa71d45c8]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:07 devstack sudo[114756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7
Aug 26 17:25:07 devstack sudo[114756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:07 devstack sudo[114756]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7" returned: 0 in 0.393s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:07 devstack sudo[114761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6
Aug 26 17:25:07 devstack sudo[114761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:07 devstack sudo[114761]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6" returned: 0 in 0.472s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:07 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:08 devstack sudo[114767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6
Aug 26 17:25:08 devstack sudo[114767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "cinder-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Lock "cinder-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Flow 'volume_create_manager' (9d4cdac2-23c6-484c-ab9e-a064b61923e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823b6b64-0493-4905-a522-317cab526d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "cinder-quobyte-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823b6b64-0493-4905-a522-317cab526d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1394369831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85091fb-4ec6-47fd-8646-954e7324cb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c2049b768b4c589927f8f5de19b652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:08Z,use_quota=True,user_id='72f7a85620d54c31b1c190d3f7ca2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43516e40-a130-45c3-ba01-b2b97945952d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43516e40-a130-45c3-ba01-b2b97945952d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1601b0-ff19-4345-a4b5-e63a2d1a4a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:08 devstack sudo[114767]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1601b0-ff19-4345-a4b5-e63a2d1a4a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85091fb-4ec6-47fd-8646-954e7324cb54', 'volume_name': 'volume-b85091fb-4ec6-47fd-8646-954e7324cb54', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94acce88-cb18-4c56-a995-12ee0a6dd8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94acce88-cb18-4c56-a995-12ee0a6dd8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21aaffd4-8549-4c1f-84eb-b293df15649a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:08 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Volume b85091fb-4ec6-47fd-8646-954e7324cb54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85091fb-4ec6-47fd-8646-954e7324cb54', 'volume_size': 1}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1394369831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85091fb-4ec6-47fd-8646-954e7324cb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c2049b768b4c589927f8f5de19b652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:08Z,use_quota=True,user_id='72f7a85620d54c31b1c190d3f7ca2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Creating volume b85091fb-4ec6-47fd-8646-954e7324cb54 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:08 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b85091fb-4ec6-47fd-8646-954e7324cb54 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Lock "cinder-quobyte-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b" acquired by "delete_volume" :: waited 0.089s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:08 devstack sudo[114770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b85091fb-4ec6-47fd-8646-954e7324cb54 1073741824
Aug 26 17:25:08 devstack sudo[114770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7.c05f7d71-6d74-41ec-87a6-5659dfad9bd6" returned: 0 in 0.361s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[96afd1fe-1ead-43fc-a9d8-5f8773fa0a87]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-c05f7d71-6d74-41ec-87a6-5659dfad9bd6" released by "_delete_snapshot" :: held 1.741s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-15ba5e5f-dfac-4680-a0b6-feb37c852fd7" released by "delete_snapshot" :: held 1.767s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Created reservations ['41a7a6d6-5932-4a45-ac59-a9de451a9a44', 'd397a21e-18e0-4d01-be78-f52004b4ebfe', '0fba0953-3601-42e7-8ac6-c123ad885d0e', 'b0df179d-8aa2-410e-9edb-2fba17f6c989'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:08 devstack sudo[114772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b
Aug 26 17:25:08 devstack sudo[114772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:08 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Delete snapshot completed successfully.
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-85bb4bfe-3add-4864-8a4f-9ff8ef26f019 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-c05f7d71-6d74-41ec-87a6-5659dfad9bd6-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:08 devstack sudo[114772]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b" returned: 0 in 0.454s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:08 devstack sudo[114782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b
Aug 26 17:25:08 devstack sudo[114782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-15ba5e5f-dfac-4680-a0b6-feb37c852fd7-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-15ba5e5f-dfac-4680-a0b6-feb37c852fd7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:08 devstack sudo[114770]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b85091fb-4ec6-47fd-8646-954e7324cb54 1073741824" returned: 0 in 0.601s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b85091fb-4ec6-47fd-8646-954e7324cb54 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-15ba5e5f-dfac-4680-a0b6-feb37c852fd7" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:08 devstack sudo[114784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b85091fb-4ec6-47fd-8646-954e7324cb54
Aug 26 17:25:08 devstack sudo[114784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:08 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-15ba5e5f-dfac-4680-a0b6-feb37c852fd7" acquired by "delete_volume" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fe9cf3-77f3-4e92-bdb4-939085ab76bd]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:09 devstack sudo[114782]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b" returned: 0 in 0.313s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Lock "cinder-quobyte-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b" released by "delete_volume" :: held 0.839s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:09 devstack sudo[114787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7
Aug 26 17:25:09 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Created reservations ['ea43ba2e-c602-4a9a-991b-3e967f08bee7', 'b6859e60-6f5b-424a-bc3c-49ef36f7916c', '476669aa-1c60-48f4-80d1-29ab3513cb14', '3701fa89-f0c9-41d9-a532-c8c758272244'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:09 devstack sudo[114784]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b85091fb-4ec6-47fd-8646-954e7324cb54" returned: 0 in 0.318s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21aaffd4-8549-4c1f-84eb-b293df15649a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85091fb-4ec6-47fd-8646-954e7324cb54', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07cec0ae-dbca-4369-b876-51499d490cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:09 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Volume volume-b85091fb-4ec6-47fd-8646-954e7324cb54 (b85091fb-4ec6-47fd-8646-954e7324cb54): created successfully
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07cec0ae-dbca-4369-b876-51499d490cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Flow 'volume_create_manager' (9d4cdac2-23c6-484c-ab9e-a064b61923e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:09 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d2a0d774-61fb-47e5-911d-7d901daa5b7c tempest-ProjectReaderTests-52449649 None] Created volume successfully.
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:09 devstack sudo[114790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:09 devstack sudo[114790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:09 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7" returned: 0 in 0.432s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:09 devstack sudo[114795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7
Aug 26 17:25:09 devstack sudo[114795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:09 devstack sudo[114790]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.263s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:09 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Deleted volume successfully.
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c0ad8ab3-d66b-41dc-b8e5-b69f8e3912f3 tempest-ProjectReaderTests-1855211133 None] Lock "cinder-ec3762b4-35cb-4bda-bb99-e40b7ca87c1b-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:09 devstack sudo[114795]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-15ba5e5f-dfac-4680-a0b6-feb37c852fd7" returned: 0 in 0.263s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-15ba5e5f-dfac-4680-a0b6-feb37c852fd7" released by "delete_volume" :: held 0.795s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Created reservations ['fcf58f1d-72b2-4f95-bdf9-5e63d4f2ad10', 'cb5cc7e6-7eaa-4c9c-b13b-43da1f83acfc', '9f689b54-948c-43a3-81a5-0c8133a96e6d', '02260cdb-3853-46e8-9674-ada453170412'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:09 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:09 devstack sudo[114799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:09 devstack sudo[114799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:10 devstack sudo[114799]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.268s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:10 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Deleted volume successfully.
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-33282742-28f1-4459-ace4-f2fda37f8ae4 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-15ba5e5f-dfac-4680-a0b6-feb37c852fd7-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (cdb6539a-0190-45db-9982-38bf25002721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae29868e-b366-4767-86b5-e75303fd7715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae29868e-b366-4767-86b5-e75303fd7715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031642558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c275ef50-8072-49b9-8d0a-f1d1d5d3a706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:10Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71719509-f10e-4f41-a5b9-0edcc2c0bc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71719509-f10e-4f41-a5b9-0edcc2c0bc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b647c899-7c5f-4bb5-b618-328a9abfc1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b647c899-7c5f-4bb5-b618-328a9abfc1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c275ef50-8072-49b9-8d0a-f1d1d5d3a706', 'volume_name': 'volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c9e61c-8fba-4008-a437-7adff4b0bf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c9e61c-8fba-4008-a437-7adff4b0bf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5112d2-692a-4ed7-a35b-36b5aacfa020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:10 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Volume c275ef50-8072-49b9-8d0a-f1d1d5d3a706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706', 'volume_size': 1}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031642558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c275ef50-8072-49b9-8d0a-f1d1d5d3a706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:10Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Creating volume c275ef50-8072-49b9-8d0a-f1d1d5d3a706 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:10 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:10 devstack sudo[114802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706 1073741824
Aug 26 17:25:10 devstack sudo[114802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Acquiring lock "cinder-b85091fb-4ec6-47fd-8646-954e7324cb54-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:10 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Lock "cinder-b85091fb-4ec6-47fd-8646-954e7324cb54-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Acquiring lock "cinder-quobyte-b85091fb-4ec6-47fd-8646-954e7324cb54" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Lock "cinder-quobyte-b85091fb-4ec6-47fd-8646-954e7324cb54" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[41199da1-b88b-48fd-a9b3-acf64571a1fb]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b85091fb-4ec6-47fd-8646-954e7324cb54 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:11 devstack sudo[114807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b85091fb-4ec6-47fd-8646-954e7324cb54
Aug 26 17:25:11 devstack sudo[114807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:11 devstack sudo[114802]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706 1073741824" returned: 0 in 0.522s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:11 devstack sudo[114810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706
Aug 26 17:25:11 devstack sudo[114810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Flow 'volume_create_manager' (01411f15-93ff-4a2d-af41-3815f19eba44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e17d1dc-344e-49cd-82ec-53a2aa27248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e17d1dc-344e-49cd-82ec-53a2aa27248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-178272228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39f271b-85f2-49d8-839d-837c50856b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b919b11f0244088037722f03a70359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:11Z,use_quota=True,user_id='9f9614662d444a57a46f71aa533a759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504075b4-8321-4b68-bf26-e0779cc365d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504075b4-8321-4b68-bf26-e0779cc365d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a37aff3-2ed5-40c9-b413-9fdf1682e513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a37aff3-2ed5-40c9-b413-9fdf1682e513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f39f271b-85f2-49d8-839d-837c50856b18', 'volume_name': 'volume-f39f271b-85f2-49d8-839d-837c50856b18', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c19a7b-f467-4e35-89bb-0d3c89f04cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c19a7b-f467-4e35-89bb-0d3c89f04cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c8929c-4424-4817-8154-ffebf19097f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:11 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Volume f39f271b-85f2-49d8-839d-837c50856b18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f39f271b-85f2-49d8-839d-837c50856b18', 'volume_size': 1}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Flow 'volume_create_manager' (426c1d03-c36f-40fc-b07b-732f81b9aad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad3a936-7a4f-4c20-94d4-4f03f9bbc969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad3a936-7a4f-4c20-94d4-4f03f9bbc969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-73920085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4225c5db-196c-464f-87a8-8b01061de187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2980034fdc1b4e62a5cdd939bf39591c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:11Z,use_quota=True,user_id='4ad72a5b96904f6c9d622bc1d770404a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2917744d-2bed-49a7-8e67-289ff54472dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2917744d-2bed-49a7-8e67-289ff54472dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:11 devstack sudo[114807]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1635ba1-f6da-461b-b6ee-78d5b2a3bba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1635ba1-f6da-461b-b6ee-78d5b2a3bba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4225c5db-196c-464f-87a8-8b01061de187', 'volume_name': 'volume-4225c5db-196c-464f-87a8-8b01061de187', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cee3159-20d8-4cf5-ad76-101144ed3eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cee3159-20d8-4cf5-ad76-101144ed3eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42165b7b-408c-4abc-8b90-d79a6c503bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:11 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Volume 4225c5db-196c-464f-87a8-8b01061de187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4225c5db-196c-464f-87a8-8b01061de187', 'volume_size': 1}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b85091fb-4ec6-47fd-8646-954e7324cb54" returned: 0 in 0.411s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b85091fb-4ec6-47fd-8646-954e7324cb54 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:11 devstack sudo[114816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b85091fb-4ec6-47fd-8646-954e7324cb54
Aug 26 17:25:11 devstack sudo[114816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:11 devstack sudo[114810]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706" returned: 0 in 0.265s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.135s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-178272228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39f271b-85f2-49d8-839d-837c50856b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b919b11f0244088037722f03a70359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:11Z,use_quota=True,user_id='9f9614662d444a57a46f71aa533a759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Creating volume f39f271b-85f2-49d8-839d-837c50856b18 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:11 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5112d2-692a-4ed7-a35b-36b5aacfa020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:11 devstack sudo[114818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18 1073741824
Aug 26 17:25:11 devstack sudo[114818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef83e03a-81bf-4123-84e4-c5329dd8a929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:11 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Volume volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706 (c275ef50-8072-49b9-8d0a-f1d1d5d3a706): created successfully
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef83e03a-81bf-4123-84e4-c5329dd8a929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (cdb6539a-0190-45db-9982-38bf25002721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:11 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7b9b415e-5455-4331-a525-b796d55a26bc tempest-ProjectMemberTests-2141364931 None] Created volume successfully.
Aug 26 17:25:11 devstack sudo[114816]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b85091fb-4ec6-47fd-8646-954e7324cb54" returned: 0 in 0.304s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Lock "cinder-quobyte-b85091fb-4ec6-47fd-8646-954e7324cb54" released by "delete_volume" :: held 0.763s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Created reservations ['8c814bee-36c8-4d14-9b38-caf886fe98a6', '3f475b61-d441-4540-a46f-e90c8b77f0ef', '1a9b05af-5a7d-4952-8bfa-0b0c72f3a25f', 'd74268d5-3b32-4624-aa7d-b8b16cb41392'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:11 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:12 devstack sudo[114825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:12 devstack sudo[114825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:12 devstack sudo[114818]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18 1073741824" returned: 0 in 0.550s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:12 devstack sudo[114827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18
Aug 26 17:25:12 devstack sudo[114827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:12 devstack sudo[114825]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.276s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:12 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Deleted volume successfully.
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b8f82f92-183b-4987-8f39-040586907fb0 tempest-ProjectReaderTests-52449649 None] Lock "cinder-b85091fb-4ec6-47fd-8646-954e7324cb54-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:12 devstack sudo[114827]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18" returned: 0 in 0.287s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.932s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-73920085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4225c5db-196c-464f-87a8-8b01061de187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2980034fdc1b4e62a5cdd939bf39591c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:11Z,use_quota=True,user_id='4ad72a5b96904f6c9d622bc1d770404a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Creating volume 4225c5db-196c-464f-87a8-8b01061de187 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:12 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4225c5db-196c-464f-87a8-8b01061de187 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c8929c-4424-4817-8154-ffebf19097f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f39f271b-85f2-49d8-839d-837c50856b18', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:12 devstack sudo[114831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4225c5db-196c-464f-87a8-8b01061de187 1073741824
Aug 26 17:25:12 devstack sudo[114831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d721b1-f25a-4ccc-a46c-b016fdcf6cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Volume volume-f39f271b-85f2-49d8-839d-837c50856b18 (f39f271b-85f2-49d8-839d-837c50856b18): created successfully
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d721b1-f25a-4ccc-a46c-b016fdcf6cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Flow 'volume_create_manager' (01411f15-93ff-4a2d-af41-3815f19eba44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:12 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c639f060-e0c3-433d-ae7a-018abd27711c tempest-ProjectReaderTests-823288463 None] Created volume successfully.
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Flow 'volume_create_manager' (3c7ef771-73ff-42dc-a770-e8739f5f1e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23180171-07ed-4f0b-b156-013221791012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23180171-07ed-4f0b-b156-013221791012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067943775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393fa691-7544-4345-b85d-fedec4606e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c2049b768b4c589927f8f5de19b652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:13Z,use_quota=True,user_id='72f7a85620d54c31b1c190d3f7ca2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49da1a23-a1f7-4f4d-960a-7e92ca1b2415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49da1a23-a1f7-4f4d-960a-7e92ca1b2415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7617056c-c14d-43d6-a2bc-1d2ff4ad704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7617056c-c14d-43d6-a2bc-1d2ff4ad704b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '393fa691-7544-4345-b85d-fedec4606e09', 'volume_name': 'volume-393fa691-7544-4345-b85d-fedec4606e09', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (114238e3-f020-4084-a670-98b36854d856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (114238e3-f020-4084-a670-98b36854d856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260dcab4-80d3-4079-8847-6cc91d13e96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:12 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Volume 393fa691-7544-4345-b85d-fedec4606e09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-393fa691-7544-4345-b85d-fedec4606e09', 'volume_size': 1}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:12 devstack sudo[114831]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4225c5db-196c-464f-87a8-8b01061de187 1073741824" returned: 0 in 0.450s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:12 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4225c5db-196c-464f-87a8-8b01061de187 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:12 devstack sudo[114837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4225c5db-196c-464f-87a8-8b01061de187
Aug 26 17:25:12 devstack sudo[114837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:13 devstack sudo[114837]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4225c5db-196c-464f-87a8-8b01061de187" returned: 0 in 0.252s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.221s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42165b7b-408c-4abc-8b90-d79a6c503bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4225c5db-196c-464f-87a8-8b01061de187', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57d62d5-0862-4813-aa88-69d1f57fe8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] Creating offline snapshot 6f1db2cb-ec5b-4664-8520-888abc59c769 of volume c275ef50-8072-49b9-8d0a-f1d1d5d3a706 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:25:13 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Volume volume-4225c5db-196c-464f-87a8-8b01061de187 (4225c5db-196c-464f-87a8-8b01061de187): created successfully
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57d62d5-0862-4813-aa88-69d1f57fe8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Flow 'volume_create_manager' (426c1d03-c36f-40fc-b07b-732f81b9aad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[268351d8-2718-4019-b79f-2fcf7e440652]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:13 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ec9de039-e292-4cdc-a515-b2b128887bb6 tempest-ProjectReaderTests-1855211133 None] Created volume successfully.
Aug 26 17:25:13 devstack sudo[114840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706
Aug 26 17:25:13 devstack sudo[114840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:13 devstack sudo[114840]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706" returned: 0 in 0.440s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:13 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:13 devstack sudo[115098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769 1G
Aug 26 17:25:13 devstack sudo[115098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:14 devstack sudo[115098]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769 1G" returned: 0 in 0.397s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:14 devstack sudo[115266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769
Aug 26 17:25:14 devstack sudo[115266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "cinder-4225c5db-196c-464f-87a8-8b01061de187-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:14 devstack sudo[115266]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769" returned: 0 in 0.315s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:14 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769 is being set with open permissions: ugo+rw
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Lock "cinder-4225c5db-196c-464f-87a8-8b01061de187-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:14 devstack sudo[115271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769
Aug 26 17:25:14 devstack sudo[115271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "cinder-quobyte-4225c5db-196c-464f-87a8-8b01061de187" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Lock "cinder-quobyte-4225c5db-196c-464f-87a8-8b01061de187" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[65585b78-17e9-424b-8997-751c81be1ee9]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4225c5db-196c-464f-87a8-8b01061de187 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:14 devstack sudo[115273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4225c5db-196c-464f-87a8-8b01061de187
Aug 26 17:25:14 devstack sudo[115273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:14 devstack sudo[115271]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769" returned: 0 in 0.256s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:14 devstack sudo[115276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.info
Aug 26 17:25:14 devstack sudo[115276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:14 devstack sudo[115273]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4225c5db-196c-464f-87a8-8b01061de187" returned: 0 in 0.352s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4225c5db-196c-464f-87a8-8b01061de187 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:14 devstack sudo[115281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4225c5db-196c-464f-87a8-8b01061de187
Aug 26 17:25:14 devstack sudo[115281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:14 devstack sudo[115276]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.info" returned: 0 in 0.259s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:14 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.info is being set with open permissions: ugo+rw
Aug 26 17:25:14 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:14 devstack sudo[115284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.info
Aug 26 17:25:14 devstack sudo[115284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:15 devstack sudo[115281]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-4225c5db-196c-464f-87a8-8b01061de187" returned: 0 in 0.249s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Lock "cinder-quobyte-4225c5db-196c-464f-87a8-8b01061de187" released by "delete_volume" :: held 0.643s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Created reservations ['3d019c49-5c2f-4d89-895f-98ad8f9e2629', '8c626a54-d4ca-4454-9e84-c1264006b3cf', '4b7ebf0d-848d-4bf6-93d3-f1065d74989b', '84b193fb-d707-4546-b0bf-44aefdcfbb72'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:15 devstack sudo[115284]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.info" returned: 0 in 0.245s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.414s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067943775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393fa691-7544-4345-b85d-fedec4606e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c2049b768b4c589927f8f5de19b652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:13Z,use_quota=True,user_id='72f7a85620d54c31b1c190d3f7ca2d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Creating volume 393fa691-7544-4345-b85d-fedec4606e09 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:15 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-393fa691-7544-4345-b85d-fedec4606e09 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:15 devstack sudo[115288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-393fa691-7544-4345-b85d-fedec4606e09 1073741824
Aug 26 17:25:15 devstack sudo[115288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:15 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-0c91791f-e04e-4479-a9d6-e9b8bfa75a88 tempest-ProjectMemberTests-2141364931 None] Create snapshot completed successfully
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:15 devstack sudo[115290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:15 devstack sudo[115290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:15 devstack sudo[115290]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.256s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:15 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Deleted volume successfully.
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f0c0c20e-0954-4efb-953a-3638880e6510 tempest-ProjectReaderTests-1855211133 None] Lock "cinder-4225c5db-196c-464f-87a8-8b01061de187-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:15 devstack sudo[115288]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-393fa691-7544-4345-b85d-fedec4606e09 1073741824" returned: 0 in 0.469s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-393fa691-7544-4345-b85d-fedec4606e09 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:15 devstack sudo[115297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-393fa691-7544-4345-b85d-fedec4606e09
Aug 26 17:25:15 devstack sudo[115297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:15 devstack sudo[115297]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Flow 'volume_create_manager' (12a94016-8d37-492a-9bf0-926f67eb097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85aebe6e-ac66-4954-b644-538a263b52dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-393fa691-7544-4345-b85d-fedec4606e09" returned: 0 in 0.290s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.554s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:15 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85aebe6e-ac66-4954-b644-538a263b52dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887434681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977e5ed9-408f-43f3-b167-e4ec91ea26b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2980034fdc1b4e62a5cdd939bf39591c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:16Z,use_quota=True,user_id='4ad72a5b96904f6c9d622bc1d770404a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9fc7125-ed8b-4c1a-852d-3ac6afcd9ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9fc7125-ed8b-4c1a-852d-3ac6afcd9ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6dc502-d052-4281-a92b-e6e542630040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6dc502-d052-4281-a92b-e6e542630040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '977e5ed9-408f-43f3-b167-e4ec91ea26b3', 'volume_name': 'volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2b3113-a6cb-433a-a0a2-99c77d57ff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2b3113-a6cb-433a-a0a2-99c77d57ff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a397f99a-42fd-436e-8346-c7663dc0b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:16 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Volume 977e5ed9-408f-43f3-b167-e4ec91ea26b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3', 'volume_size': 1}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260dcab4-80d3-4079-8847-6cc91d13e96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-393fa691-7544-4345-b85d-fedec4606e09', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162064af-58da-49d8-9cee-58d31ba99a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] Creating offline snapshot 1f52d10e-1d24-4530-baf4-212690f2492b of volume f39f271b-85f2-49d8-839d-837c50856b18 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-6f1db2cb-ec5b-4664-8520-888abc59c769-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:16 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Volume volume-393fa691-7544-4345-b85d-fedec4606e09 (393fa691-7544-4345-b85d-fedec4606e09): created successfully
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162064af-58da-49d8-9cee-58d31ba99a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Flow 'volume_create_manager' (3c7ef771-73ff-42dc-a770-e8739f5f1e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d987b9a-0744-4019-bc91-6a173c0cad16]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-6f1db2cb-ec5b-4664-8520-888abc59c769-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-c275ef50-8072-49b9-8d0a-f1d1d5d3a706" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:16 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-279ac09a-6e73-4adf-94f6-f06700774731 tempest-ProjectReaderTests-52449649 None] Created volume successfully.
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-c275ef50-8072-49b9-8d0a-f1d1d5d3a706" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-6f1db2cb-ec5b-4664-8520-888abc59c769" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-6f1db2cb-ec5b-4664-8520-888abc59c769" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Deleting offline snapshot 6f1db2cb-ec5b-4664-8520-888abc59c769 of volume c275ef50-8072-49b9-8d0a-f1d1d5d3a706 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] snapshot_file for this snap is: volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd143012-9fcf-4c8b-a08e-cee6705ff9eb]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:16 devstack sudo[115300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18
Aug 26 17:25:16 devstack sudo[115300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:16 devstack sudo[115301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769
Aug 26 17:25:16 devstack sudo[115301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:16 devstack sudo[115300]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18" returned: 0 in 0.374s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:16 devstack sudo[115308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b 1G
Aug 26 17:25:16 devstack sudo[115308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:16 devstack sudo[115301]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769" returned: 0 in 0.360s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e5bd52-e3d4-4ed0-8a8d-4011b688cdd2]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:16 devstack sudo[115313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706
Aug 26 17:25:16 devstack sudo[115313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:16 devstack sudo[115308]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Acquiring lock "cinder-393fa691-7544-4345-b85d-fedec4606e09-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b 1G" returned: 0 in 0.441s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f39f271b-85f2-49d8-839d-837c50856b18 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Lock "cinder-393fa691-7544-4345-b85d-fedec4606e09-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:16 devstack sudo[115320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f39f271b-85f2-49d8-839d-837c50856b18 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b
Aug 26 17:25:16 devstack sudo[115320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Acquiring lock "cinder-quobyte-393fa691-7544-4345-b85d-fedec4606e09" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:16 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Lock "cinder-quobyte-393fa691-7544-4345-b85d-fedec4606e09" acquired by "delete_volume" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:16 devstack sudo[115313]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706" returned: 0 in 0.438s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[1113884c-26dd-43d9-b57c-67991a44a0c0]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-393fa691-7544-4345-b85d-fedec4606e09 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:17 devstack sudo[115323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769
Aug 26 17:25:17 devstack sudo[115323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:17 devstack sudo[115324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-393fa691-7544-4345-b85d-fedec4606e09
Aug 26 17:25:17 devstack sudo[115324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:17 devstack sudo[115320]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f39f271b-85f2-49d8-839d-837c50856b18 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b" returned: 0 in 0.310s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:17 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b is being set with open permissions: ugo+rw
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:17 devstack sudo[115331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b
Aug 26 17:25:17 devstack sudo[115331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:17 devstack sudo[115323]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769" returned: 0 in 0.362s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:17 devstack sudo[115324]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:17 devstack sudo[115340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769
Aug 26 17:25:17 devstack sudo[115340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-393fa691-7544-4345-b85d-fedec4606e09" returned: 0 in 0.373s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-393fa691-7544-4345-b85d-fedec4606e09 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:17 devstack sudo[115342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-393fa691-7544-4345-b85d-fedec4606e09
Aug 26 17:25:17 devstack sudo[115342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:17 devstack sudo[115331]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b" returned: 0 in 0.277s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:17 devstack sudo[115345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.info
Aug 26 17:25:17 devstack sudo[115345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:17 devstack sudo[115340]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706.6f1db2cb-ec5b-4664-8520-888abc59c769" returned: 0 in 0.269s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:17 devstack sudo[115342]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-393fa691-7544-4345-b85d-fedec4606e09" returned: 0 in 0.265s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-6f1db2cb-ec5b-4664-8520-888abc59c769" released by "_delete_snapshot" :: held 1.524s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-c275ef50-8072-49b9-8d0a-f1d1d5d3a706" released by "delete_snapshot" :: held 1.551s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Lock "cinder-quobyte-393fa691-7544-4345-b85d-fedec4606e09" released by "delete_volume" :: held 0.697s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Created reservations ['04831b76-ff04-40bf-9392-5370172b5f82', '26e1f14f-17f1-46b2-a0b1-138ee319762c', '1a92a43c-0f5f-46de-afdd-4cf1cf5716ff', '1e13366f-9f7d-4b13-ab56-58445b5957eb'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Created reservations ['e6d05a4e-62e1-47c9-8384-7d936bbcc6c6', '529a5ba8-cad0-4392-af1e-017c04aeebc0', '281bb7e4-1e70-4fd2-8be0-6ef2c34d99ed', '744b6139-2b55-4f27-96a3-9f0c96a48d80'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:17 devstack sudo[115345]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.info" returned: 0 in 0.268s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:17 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.info is being set with open permissions: ugo+rw
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:17 devstack sudo[115350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.info
Aug 26 17:25:17 devstack sudo[115350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:17 devstack sudo[115352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:17 devstack sudo[115352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:17 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Delete snapshot completed successfully.
Aug 26 17:25:17 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-87799594-5b68-4b9f-b175-89f4ad00cbf7 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-6f1db2cb-ec5b-4664-8520-888abc59c769-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:18 devstack sudo[115350]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.info" returned: 0 in 0.266s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.059s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887434681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977e5ed9-408f-43f3-b167-e4ec91ea26b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2980034fdc1b4e62a5cdd939bf39591c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:16Z,use_quota=True,user_id='4ad72a5b96904f6c9d622bc1d770404a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Creating volume 977e5ed9-408f-43f3-b167-e4ec91ea26b3 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:18 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:18 devstack sudo[115352]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.268s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:18 devstack sudo[115356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3 1073741824
Aug 26 17:25:18 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Deleted volume successfully.
Aug 26 17:25:18 devstack sudo[115356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:18 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-21d01802-0a18-4426-8f94-1349c1fcd66c tempest-ProjectReaderTests-823288463 None] Create snapshot completed successfully
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-178399cf-075c-4312-9d47-f6371e2371bf tempest-ProjectReaderTests-52449649 None] Lock "cinder-393fa691-7544-4345-b85d-fedec4606e09-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-c275ef50-8072-49b9-8d0a-f1d1d5d3a706-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Lock "cinder-c275ef50-8072-49b9-8d0a-f1d1d5d3a706-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-c275ef50-8072-49b9-8d0a-f1d1d5d3a706" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-c275ef50-8072-49b9-8d0a-f1d1d5d3a706" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[6978529a-d00e-40f1-9f8f-63d63a995fa7]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:18 devstack sudo[115361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706
Aug 26 17:25:18 devstack sudo[115361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:18 devstack sudo[115356]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3 1073741824" returned: 0 in 0.635s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:18 devstack sudo[115367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3
Aug 26 17:25:18 devstack sudo[115367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:18 devstack sudo[115361]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706" returned: 0 in 0.465s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:18 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:18 devstack sudo[115369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706
Aug 26 17:25:18 devstack sudo[115369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-1f52d10e-1d24-4530-baf4-212690f2492b-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:19 devstack sudo[115367]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Lock "cinder-1f52d10e-1d24-4530-baf4-212690f2492b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-f39f271b-85f2-49d8-839d-837c50856b18" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3" returned: 0 in 0.326s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a397f99a-42fd-436e-8346-c7663dc0b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7db88ff-ae05-49e5-b6bb-25a4e4642132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-f39f271b-85f2-49d8-839d-837c50856b18" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-1f52d10e-1d24-4530-baf4-212690f2492b" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:19 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Volume volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3 (977e5ed9-408f-43f3-b167-e4ec91ea26b3): created successfully
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7db88ff-ae05-49e5-b6bb-25a4e4642132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Flow 'volume_create_manager' (12a94016-8d37-492a-9bf0-926f67eb097e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-1f52d10e-1d24-4530-baf4-212690f2492b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Deleting offline snapshot 1f52d10e-1d24-4530-baf4-212690f2492b of volume f39f271b-85f2-49d8-839d-837c50856b18 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] snapshot_file for this snap is: volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:25:19 devstack sudo[115369]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73abcd4-ea5a-4503-b427-72ee9595f90b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8e40360c-1955-4176-8e9a-671dcf0f6a64 tempest-ProjectReaderTests-1855211133 None] Created volume successfully.
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-c275ef50-8072-49b9-8d0a-f1d1d5d3a706" returned: 0 in 0.380s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-c275ef50-8072-49b9-8d0a-f1d1d5d3a706" released by "delete_volume" :: held 0.920s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Created reservations ['c97b2df9-09e7-4ab4-95c7-af92273795fa', '526fd695-ea9f-436d-a6c1-c52e0fd3c431', '7c7d3d61-4c88-4b3f-96aa-a50143c937e9', '056e9c46-63b9-467a-9321-e47c4cc398e6'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:19 devstack sudo[115373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b
Aug 26 17:25:19 devstack sudo[115373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:19 devstack sudo[115375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:19 devstack sudo[115375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:19 devstack sudo[115373]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b" returned: 0 in 0.451s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f39f271b-85f2-49d8-839d-837c50856b18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b405da-b552-4b22-ba10-0d2467fcc520]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:19 devstack sudo[115375]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.258s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:19 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Deleted volume successfully.
Aug 26 17:25:19 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-8df68fde-4945-428d-965c-d90f1ba0214a tempest-ProjectMemberTests-2141364931 None] Lock "cinder-c275ef50-8072-49b9-8d0a-f1d1d5d3a706-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:19 devstack sudo[115381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18
Aug 26 17:25:19 devstack sudo[115381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:20 devstack sudo[115381]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18" returned: 0 in 0.424s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:20 devstack sudo[115386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b
Aug 26 17:25:20 devstack sudo[115386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Acquiring lock "cinder-977e5ed9-408f-43f3-b167-e4ec91ea26b3-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Lock "cinder-977e5ed9-408f-43f3-b167-e4ec91ea26b3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Acquiring lock "cinder-quobyte-977e5ed9-408f-43f3-b167-e4ec91ea26b3" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Lock "cinder-quobyte-977e5ed9-408f-43f3-b167-e4ec91ea26b3" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[857cc5be-ecba-42bf-8d67-1254cddc8ddb]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:20 devstack sudo[115388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3
Aug 26 17:25:20 devstack sudo[115388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:20 devstack sudo[115386]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b" returned: 0 in 0.439s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:20 devstack sudo[115393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b
Aug 26 17:25:20 devstack sudo[115393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:20 devstack sudo[115388]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3" returned: 0 in 0.463s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:20 devstack sudo[115398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3
Aug 26 17:25:20 devstack sudo[115398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:20 devstack sudo[115393]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18.1f52d10e-1d24-4530-baf4-212690f2492b" returned: 0 in 0.298s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-1f52d10e-1d24-4530-baf4-212690f2492b" released by "_delete_snapshot" :: held 1.752s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-f39f271b-85f2-49d8-839d-837c50856b18" released by "delete_snapshot" :: held 1.797s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:20 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (b7a34d42-e994-4651-983f-1c85f81b94b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba603c4a-2d1c-42ed-b1d5-d604623b4bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba603c4a-2d1c-42ed-b1d5-d604623b4bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593021806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e6fcdf-1234-4a59-98c2-aa0111911073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:21Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8b7bef-1fc2-4935-84c3-521cbf46afed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8b7bef-1fc2-4935-84c3-521cbf46afed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d651045-7238-4ee0-a18b-d980628f8bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d651045-7238-4ee0-a18b-d980628f8bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e6fcdf-1234-4a59-98c2-aa0111911073', 'volume_name': 'volume-b4e6fcdf-1234-4a59-98c2-aa0111911073', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb123e8b-3bad-45d4-bc7e-e70217aab594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb123e8b-3bad-45d4-bc7e-e70217aab594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0886ae1e-66ce-4c68-933f-d37e21272251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:21 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Volume b4e6fcdf-1234-4a59-98c2-aa0111911073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e6fcdf-1234-4a59-98c2-aa0111911073', 'volume_size': 1}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593021806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e6fcdf-1234-4a59-98c2-aa0111911073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:21Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Creating volume b4e6fcdf-1234-4a59-98c2-aa0111911073 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:21 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:21 devstack sudo[115398]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-977e5ed9-408f-43f3-b167-e4ec91ea26b3" returned: 0 in 0.275s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:21 devstack sudo[115402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073 1073741824
Aug 26 17:25:21 devstack sudo[115402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Lock "cinder-quobyte-977e5ed9-408f-43f3-b167-e4ec91ea26b3" released by "delete_volume" :: held 0.787s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Created reservations ['c91a0b94-d6ec-4f6b-a304-88ec054c68f0', '343905a2-8c9c-4276-85a2-600616946c77', 'c0d5166e-2495-4595-b159-1eaeb5236acc', '46bdffcc-5202-4432-8884-a302753c6662'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Created reservations ['036c5aab-a632-42b3-b608-6b2548d3c751', 'e9965eb3-db2c-4939-8d85-db8d11c54a56', '2c99fb03-5b26-4b8c-8dbd-9362fcf40227', '17b406f2-0872-482f-9e21-b4f4d6ad6157'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:21 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Delete snapshot completed successfully.
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e7e00471-5a24-4d2b-863e-ab9b14dfa496 tempest-ProjectReaderTests-823288463 None] Lock "cinder-1f52d10e-1d24-4530-baf4-212690f2492b-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-f39f271b-85f2-49d8-839d-837c50856b18-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:21 devstack sudo[115404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:21 devstack sudo[115404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Lock "cinder-f39f271b-85f2-49d8-839d-837c50856b18-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-f39f271b-85f2-49d8-839d-837c50856b18" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-f39f271b-85f2-49d8-839d-837c50856b18" acquired by "delete_volume" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6f3421-157e-4d13-9db4-8b35483abc8b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:21 devstack sudo[115409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18
Aug 26 17:25:21 devstack sudo[115409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:21 devstack sudo[115404]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.318s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:21 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Deleted volume successfully.
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-296dbab3-1ba4-47e2-a006-ff46c709204b tempest-ProjectReaderTests-1855211133 None] Lock "cinder-977e5ed9-408f-43f3-b167-e4ec91ea26b3-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:21 devstack sudo[115402]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073 1073741824" returned: 0 in 0.563s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:21 devstack sudo[115413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073
Aug 26 17:25:21 devstack sudo[115413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:21 devstack sudo[115409]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18" returned: 0 in 0.428s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:21 devstack sudo[115418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18
Aug 26 17:25:21 devstack sudo[115418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Flow 'volume_create_manager' (78464e32-6566-4b00-a205-6f77ff4514e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d512a1-0064-4057-b7d8-6c0232da737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:21 devstack sudo[115413]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d512a1-0064-4057-b7d8-6c0232da737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-923767821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11eefc07-6aa8-44db-904b-cd176dfe6582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2980034fdc1b4e62a5cdd939bf39591c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:22Z,use_quota=True,user_id='4ad72a5b96904f6c9d622bc1d770404a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2148ba0b-5e0e-4d5a-ab30-cb977135fb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:21 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2148ba0b-5e0e-4d5a-ab30-cb977135fb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5875fb02-6925-4011-886d-27bcd7566d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5875fb02-6925-4011-886d-27bcd7566d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11eefc07-6aa8-44db-904b-cd176dfe6582', 'volume_name': 'volume-11eefc07-6aa8-44db-904b-cd176dfe6582', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0821fa33-595f-4695-897b-cf86b4ec1f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0821fa33-595f-4695-897b-cf86b4ec1f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3574a19-9743-4236-ab0d-9eb5a09d8a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:22 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Volume 11eefc07-6aa8-44db-904b-cd176dfe6582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11eefc07-6aa8-44db-904b-cd176dfe6582', 'volume_size': 1}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073" returned: 0 in 0.332s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-923767821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11eefc07-6aa8-44db-904b-cd176dfe6582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2980034fdc1b4e62a5cdd939bf39591c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:22Z,use_quota=True,user_id='4ad72a5b96904f6c9d622bc1d770404a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Creating volume 11eefc07-6aa8-44db-904b-cd176dfe6582 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:22 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-11eefc07-6aa8-44db-904b-cd176dfe6582 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0886ae1e-66ce-4c68-933f-d37e21272251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e6fcdf-1234-4a59-98c2-aa0111911073', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:22 devstack sudo[115421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-11eefc07-6aa8-44db-904b-cd176dfe6582 1073741824
Aug 26 17:25:22 devstack sudo[115421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59349b9-07c7-492f-af0f-cdcc121c6cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:22 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Volume volume-b4e6fcdf-1234-4a59-98c2-aa0111911073 (b4e6fcdf-1234-4a59-98c2-aa0111911073): created successfully
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59349b9-07c7-492f-af0f-cdcc121c6cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (b7a34d42-e994-4651-983f-1c85f81b94b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:22 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8729feda-ee67-48d8-b52e-14df4193babf tempest-ProjectMemberTests-2141364931 None] Created volume successfully.
Aug 26 17:25:22 devstack sudo[115418]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-f39f271b-85f2-49d8-839d-837c50856b18" returned: 0 in 0.281s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-f39f271b-85f2-49d8-839d-837c50856b18" released by "delete_volume" :: held 0.768s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Created reservations ['fe06613d-d99d-44cc-9180-4f0471245f32', 'd8e84a8e-fbc9-41d5-b872-446e21d77d30', '6fdbaa66-8280-40b3-be51-316febe5107f', '87858daf-f1f3-41e6-a7cd-372d82ed2501'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:22 devstack sudo[115426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:22 devstack sudo[115426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:22 devstack sudo[115421]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-11eefc07-6aa8-44db-904b-cd176dfe6582 1073741824" returned: 0 in 0.478s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:22 devstack sudo[115426]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-11eefc07-6aa8-44db-904b-cd176dfe6582 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.305s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:22 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Deleted volume successfully.
Aug 26 17:25:22 devstack sudo[115431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-11eefc07-6aa8-44db-904b-cd176dfe6582
Aug 26 17:25:22 devstack sudo[115431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-1b01f5a2-147a-4ad4-99a4-3f8f207731e2 tempest-ProjectReaderTests-823288463 None] Lock "cinder-f39f271b-85f2-49d8-839d-837c50856b18-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:22 devstack sudo[115431]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-11eefc07-6aa8-44db-904b-cd176dfe6582" returned: 0 in 0.258s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3574a19-9743-4236-ab0d-9eb5a09d8a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11eefc07-6aa8-44db-904b-cd176dfe6582', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4979ee0d-686f-495f-8dc5-c366dcab4061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:22 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Volume volume-11eefc07-6aa8-44db-904b-cd176dfe6582 (11eefc07-6aa8-44db-904b-cd176dfe6582): created successfully
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4979ee0d-686f-495f-8dc5-c366dcab4061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Flow 'volume_create_manager' (78464e32-6566-4b00-a205-6f77ff4514e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:22 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-8b42c602-b0e3-4089-99c6-a9dc84df4499 tempest-ProjectReaderTests-1855211133 None] Created volume successfully.
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Flow 'volume_create_manager' (de995f91-99d7-4e4f-8953-b37995f079f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:22 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a66326-5771-44f3-9544-2d44cd647fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a66326-5771-44f3-9544-2d44cd647fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2112087578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecb8645-a0e6-40c9-970d-1c9ada70776f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b919b11f0244088037722f03a70359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:23Z,use_quota=True,user_id='9f9614662d444a57a46f71aa533a759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9c2796-4a8f-4f72-889e-33bf26373428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9c2796-4a8f-4f72-889e-33bf26373428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc7570c-7efc-462b-878d-a7a47a90fa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc7570c-7efc-462b-878d-a7a47a90fa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aecb8645-a0e6-40c9-970d-1c9ada70776f', 'volume_name': 'volume-aecb8645-a0e6-40c9-970d-1c9ada70776f', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5b234a-ca37-4e6c-9c9e-848d38a6920c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5b234a-ca37-4e6c-9c9e-848d38a6920c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c0f715-8340-4950-9556-ad5addef42a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:23 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Volume aecb8645-a0e6-40c9-970d-1c9ada70776f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aecb8645-a0e6-40c9-970d-1c9ada70776f', 'volume_size': 1}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2112087578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecb8645-a0e6-40c9-970d-1c9ada70776f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b919b11f0244088037722f03a70359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:23Z,use_quota=True,user_id='9f9614662d444a57a46f71aa533a759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Creating volume aecb8645-a0e6-40c9-970d-1c9ada70776f {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:23 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:23 devstack sudo[115434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f 1073741824
Aug 26 17:25:23 devstack sudo[115434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:23 devstack sudo[115434]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f 1073741824" returned: 0 in 0.470s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:23 devstack sudo[115439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f
Aug 26 17:25:23 devstack sudo[115439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:23 devstack sudo[115439]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f" returned: 0 in 0.241s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.528s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c0f715-8340-4950-9556-ad5addef42a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aecb8645-a0e6-40c9-970d-1c9ada70776f', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9adb1c-e610-4de3-93ec-0781aafb51a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] Creating offline snapshot 3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1 of volume b4e6fcdf-1234-4a59-98c2-aa0111911073 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:25:23 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Volume volume-aecb8645-a0e6-40c9-970d-1c9ada70776f (aecb8645-a0e6-40c9-970d-1c9ada70776f): created successfully
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9adb1c-e610-4de3-93ec-0781aafb51a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Flow 'volume_create_manager' (de995f91-99d7-4e4f-8953-b37995f079f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e098613d-3dbb-4f5c-9d2c-08853ef28a60]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:23 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:23 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-965638df-066f-4c78-82ad-ee7ceb0352a6 tempest-ProjectReaderTests-823288463 None] Created volume successfully.
Aug 26 17:25:23 devstack sudo[115442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073
Aug 26 17:25:23 devstack sudo[115442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "cinder-11eefc07-6aa8-44db-904b-cd176dfe6582-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Lock "cinder-11eefc07-6aa8-44db-904b-cd176dfe6582-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "cinder-quobyte-11eefc07-6aa8-44db-904b-cd176dfe6582" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Lock "cinder-quobyte-11eefc07-6aa8-44db-904b-cd176dfe6582" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[259da68e-80b5-4e9b-85b4-03ee7d648f4e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-11eefc07-6aa8-44db-904b-cd176dfe6582 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:24 devstack sudo[115442]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:24 devstack sudo[115444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-11eefc07-6aa8-44db-904b-cd176dfe6582
Aug 26 17:25:24 devstack sudo[115444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073" returned: 0 in 0.437s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:24 devstack sudo[115449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1 1G
Aug 26 17:25:24 devstack sudo[115449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:24 devstack sudo[115444]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-11eefc07-6aa8-44db-904b-cd176dfe6582" returned: 0 in 0.371s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-11eefc07-6aa8-44db-904b-cd176dfe6582 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:24 devstack sudo[115458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-11eefc07-6aa8-44db-904b-cd176dfe6582
Aug 26 17:25:24 devstack sudo[115458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:24 devstack sudo[115449]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1 1G" returned: 0 in 0.433s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4e6fcdf-1234-4a59-98c2-aa0111911073 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:24 devstack sudo[115460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4e6fcdf-1234-4a59-98c2-aa0111911073 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1
Aug 26 17:25:24 devstack sudo[115460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:24 devstack sudo[115458]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-11eefc07-6aa8-44db-904b-cd176dfe6582" returned: 0 in 0.260s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Lock "cinder-quobyte-11eefc07-6aa8-44db-904b-cd176dfe6582" released by "delete_volume" :: held 0.687s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Created reservations ['162a7026-88c1-4156-9f9d-6b3542c3a79b', '7ba3a5b1-3903-4d19-8cf2-829872cce9da', '1d67e5a8-1c14-4dc7-8103-0074888cb140', '74c29569-48e8-4b2c-bc67-4dd7b6f882a4'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:24 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:24 devstack sudo[115463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:24 devstack sudo[115463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:25 devstack sudo[115460]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4e6fcdf-1234-4a59-98c2-aa0111911073 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1" returned: 0 in 0.285s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:25 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1 is being set with open permissions: ugo+rw
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:25 devstack sudo[115468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1
Aug 26 17:25:25 devstack sudo[115468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:25 devstack sudo[115463]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.256s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:25 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Deleted volume successfully.
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d7e05bde-c16f-4a99-aec7-d13cc4e73400 tempest-ProjectReaderTests-1855211133 None] Lock "cinder-11eefc07-6aa8-44db-904b-cd176dfe6582-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:25 devstack sudo[115468]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1" returned: 0 in 0.262s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:25 devstack sudo[115472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.info
Aug 26 17:25:25 devstack sudo[115472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:25 devstack sudo[115472]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.info" returned: 0 in 0.259s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:25 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.info is being set with open permissions: ugo+rw
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:25 devstack sudo[115475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.info
Aug 26 17:25:25 devstack sudo[115475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:25 devstack sudo[115475]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.info" returned: 0 in 0.248s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.625s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] Creating offline snapshot 3727bc4c-d85e-4f02-b1b0-e0a046636be1 of volume aecb8645-a0e6-40c9-970d-1c9ada70776f {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:25:25 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e200e936-15f1-40b6-8408-167f7d425fb9 tempest-ProjectMemberTests-2141364931 None] Create snapshot completed successfully
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f1039a-2d33-489d-8a39-70c211d5b4a3]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:25 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:25 devstack sudo[115478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f
Aug 26 17:25:25 devstack sudo[115478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:26 devstack sudo[115478]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f" returned: 0 in 0.429s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:26 devstack sudo[115517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1 1G
Aug 26 17:25:26 devstack sudo[115517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Lock "cinder-3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-b4e6fcdf-1234-4a59-98c2-aa0111911073" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-b4e6fcdf-1234-4a59-98c2-aa0111911073" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Deleting offline snapshot 3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1 of volume b4e6fcdf-1234-4a59-98c2-aa0111911073 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] snapshot_file for this snap is: volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a119d5-f265-4e0d-8675-50e20ee88d20]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:26 devstack sudo[115525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1
Aug 26 17:25:26 devstack sudo[115525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:26 devstack sudo[115517]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1 1G" returned: 0 in 0.586s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:26 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aecb8645-a0e6-40c9-970d-1c9ada70776f -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:26 devstack sudo[115529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aecb8645-a0e6-40c9-970d-1c9ada70776f -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1
Aug 26 17:25:26 devstack sudo[115529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:27 devstack sudo[115525]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1" returned: 0 in 0.416s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4e6fcdf-1234-4a59-98c2-aa0111911073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d7c8b6-b4c2-450b-a88e-de9ad1ad4fb5]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:27 devstack sudo[115529]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aecb8645-a0e6-40c9-970d-1c9ada70776f -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1" returned: 0 in 0.331s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:27 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1 is being set with open permissions: ugo+rw
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:27 devstack sudo[115534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073
Aug 26 17:25:27 devstack sudo[115534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:27 devstack sudo[115539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1
Aug 26 17:25:27 devstack sudo[115539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:27 devstack sudo[115539]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1" returned: 0 in 0.240s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:27 devstack sudo[115534]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073" returned: 0 in 0.378s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:27 devstack sudo[115545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1
Aug 26 17:25:27 devstack sudo[115545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:27 devstack sudo[115546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.info
Aug 26 17:25:27 devstack sudo[115546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:27 devstack sudo[115546]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.info" returned: 0 in 0.242s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:27 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.info is being set with open permissions: ugo+rw
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:27 devstack sudo[115554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.info
Aug 26 17:25:27 devstack sudo[115554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:27 devstack sudo[115545]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1" returned: 0 in 0.334s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:27 devstack sudo[115556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1
Aug 26 17:25:27 devstack sudo[115556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:27 devstack sudo[115554]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:27 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.info" returned: 0 in 0.239s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:28 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c07575b4-f60d-4b71-a7b9-f14188169226 tempest-ProjectReaderTests-823288463 None] Create snapshot completed successfully
Aug 26 17:25:28 devstack sudo[115556]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073.3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1" returned: 0 in 0.262s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1" released by "_delete_snapshot" :: held 1.505s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-b4e6fcdf-1234-4a59-98c2-aa0111911073" released by "delete_snapshot" :: held 1.538s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Created reservations ['ce408106-2046-41d7-a7fc-327e472f1230', '97191d71-6c0d-47c7-9fa2-7c5a5678dbc6', '22df313a-200a-4917-a9ae-edfa82571f76', '8bfd3ba7-4e77-49d0-8563-554b9ddf57b1'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:28 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Delete snapshot completed successfully.
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-4c53cf62-179a-4939-ab92-bd4a1103e5cf tempest-ProjectMemberTests-2141364931 None] Lock "cinder-3f328ef3-bddd-4ec1-8389-e3e8fc1b16e1-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-3727bc4c-d85e-4f02-b1b0-e0a046636be1-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Lock "cinder-3727bc4c-d85e-4f02-b1b0-e0a046636be1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-aecb8645-a0e6-40c9-970d-1c9ada70776f" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-aecb8645-a0e6-40c9-970d-1c9ada70776f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-3727bc4c-d85e-4f02-b1b0-e0a046636be1" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-3727bc4c-d85e-4f02-b1b0-e0a046636be1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Deleting offline snapshot 3727bc4c-d85e-4f02-b1b0-e0a046636be1 of volume aecb8645-a0e6-40c9-970d-1c9ada70776f {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] snapshot_file for this snap is: volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2b163e-57dc-4e3a-af89-6f00bdb8fa38]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:28 devstack sudo[115560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1
Aug 26 17:25:28 devstack sudo[115560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-b4e6fcdf-1234-4a59-98c2-aa0111911073-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-b4e6fcdf-1234-4a59-98c2-aa0111911073-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-b4e6fcdf-1234-4a59-98c2-aa0111911073" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-b4e6fcdf-1234-4a59-98c2-aa0111911073" acquired by "delete_volume" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b322c5c6-0880-4aad-bd50-8adbbccb87de]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:28 devstack sudo[115560]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1" returned: 0 in 0.390s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aecb8645-a0e6-40c9-970d-1c9ada70776f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd9ffc7-eb02-400f-bb47-004f461afddb]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:28 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:28 devstack sudo[115564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073
Aug 26 17:25:28 devstack sudo[115564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:29 devstack sudo[115572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f
Aug 26 17:25:29 devstack sudo[115572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:29 devstack sudo[115564]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073" returned: 0 in 0.359s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:29 devstack sudo[115578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073
Aug 26 17:25:29 devstack sudo[115578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:29 devstack sudo[115572]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f" returned: 0 in 0.367s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:29 devstack sudo[115583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1
Aug 26 17:25:29 devstack sudo[115583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:29 devstack sudo[115578]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-b4e6fcdf-1234-4a59-98c2-aa0111911073" returned: 0 in 0.251s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-b4e6fcdf-1234-4a59-98c2-aa0111911073" released by "delete_volume" :: held 0.674s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Created reservations ['591cdfc2-bb50-4a96-bf09-8a5d577d40e3', 'e3967fe9-af04-45fa-806a-c524ba46d26d', 'ae476efc-f899-4207-ae27-4f555a0ca622', '8873f5ae-c8fc-4d01-aa38-a713aec534aa'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:29 devstack sudo[115590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:29 devstack sudo[115590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:29 devstack sudo[115583]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1" returned: 0 in 0.352s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:29 devstack sudo[115592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1
Aug 26 17:25:29 devstack sudo[115592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:29 devstack sudo[115590]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.249s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:29 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Deleted volume successfully.
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d8201e92-8108-43c6-92ac-2ca5f0100dd7 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-b4e6fcdf-1234-4a59-98c2-aa0111911073-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:29 devstack sudo[115592]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f.3727bc4c-d85e-4f02-b1b0-e0a046636be1" returned: 0 in 0.254s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-3727bc4c-d85e-4f02-b1b0-e0a046636be1" released by "_delete_snapshot" :: held 1.470s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-aecb8645-a0e6-40c9-970d-1c9ada70776f" released by "delete_snapshot" :: held 1.495s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:29 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Created reservations ['c086377d-d5de-4be5-aff2-4a54f0ffc73e', 'd05f05a9-d585-4219-9ffe-8b57918c04ce', '56b071ee-5b02-4721-9e78-b8536bc25aaf', '109a1849-efcc-4c3f-87df-ec04f24c6a12'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:30 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Delete snapshot completed successfully.
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3e66c94e-0d37-405b-89dc-aabd4f40bf98 tempest-ProjectReaderTests-823288463 None] Lock "cinder-3727bc4c-d85e-4f02-b1b0-e0a046636be1-delete_snapshot" released by "delete_snapshot" :: held 1.633s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (ebeaec58-a508-47f3-8289-268c797fcd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50f1533-d2f4-4a51-945b-804ac47b822f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50f1533-d2f4-4a51-945b-804ac47b822f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-912688060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d698ccd2-67c6-4c40-a44f-e54af8ab4340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:30Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e634897-5182-44b7-aac2-5d749fe2f498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e634897-5182-44b7-aac2-5d749fe2f498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3e4631-4c56-451b-a134-66fec964b032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3e4631-4c56-451b-a134-66fec964b032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd698ccd2-67c6-4c40-a44f-e54af8ab4340', 'volume_name': 'volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74cfd41-932f-4007-9a06-583c986d0e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74cfd41-932f-4007-9a06-583c986d0e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60d0554-ad45-41cd-bb76-1c8dd7c49e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:30 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Volume d698ccd2-67c6-4c40-a44f-e54af8ab4340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340', 'volume_size': 1}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-912688060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d698ccd2-67c6-4c40-a44f-e54af8ab4340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:30Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Creating volume d698ccd2-67c6-4c40-a44f-e54af8ab4340 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:30 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:30 devstack sudo[115596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340 1073741824
Aug 26 17:25:30 devstack sudo[115596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-aecb8645-a0e6-40c9-970d-1c9ada70776f-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Lock "cinder-aecb8645-a0e6-40c9-970d-1c9ada70776f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-aecb8645-a0e6-40c9-970d-1c9ada70776f" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-aecb8645-a0e6-40c9-970d-1c9ada70776f" acquired by "delete_volume" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d366b2-3ecd-48fb-ba76-cfad90d702b2]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:30 devstack sudo[115602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f
Aug 26 17:25:30 devstack sudo[115602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:30 devstack sudo[115596]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340 1073741824" returned: 0 in 0.464s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:30 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:30 devstack sudo[115604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340
Aug 26 17:25:30 devstack sudo[115604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:31 devstack sudo[115602]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f" returned: 0 in 0.379s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:31 devstack sudo[115610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f
Aug 26 17:25:31 devstack sudo[115610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:31 devstack sudo[115604]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340" returned: 0 in 0.248s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60d0554-ad45-41cd-bb76-1c8dd7c49e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65762063-5c89-4a74-b0f9-56a191698b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:31 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Volume volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340 (d698ccd2-67c6-4c40-a44f-e54af8ab4340): created successfully
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65762063-5c89-4a74-b0f9-56a191698b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (ebeaec58-a508-47f3-8289-268c797fcd24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:31 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-358884b2-1b1a-445a-9abb-f5f2d1009ab0 tempest-ProjectMemberTests-2141364931 None] Created volume successfully.
Aug 26 17:25:31 devstack sudo[115610]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-aecb8645-a0e6-40c9-970d-1c9ada70776f" returned: 0 in 0.253s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-aecb8645-a0e6-40c9-970d-1c9ada70776f" released by "delete_volume" :: held 0.696s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Created reservations ['d70fb4a7-8ca3-41a5-90b9-a669a71fec80', '3fe29585-b7f1-4cb2-8d0c-6fb80d856b5c', '0cc58c50-7a4a-4e13-a5a4-8a167fde3d83', 'de58a916-106d-427a-9cc3-18f860e7dbd4'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:31 devstack sudo[115613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:31 devstack sudo[115613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] Creating offline snapshot 5156d641-7140-48b3-91d5-cec643c6ec6c of volume d698ccd2-67c6-4c40-a44f-e54af8ab4340 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4a7531-87b5-4f89-9c04-ef8cea16552f]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:31 devstack sudo[115615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340
Aug 26 17:25:31 devstack sudo[115615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:31 devstack sudo[115613]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.258s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:31 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Deleted volume successfully.
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-89f0f1fc-e6a2-4cb8-abd7-706e264d7eec tempest-ProjectReaderTests-823288463 None] Lock "cinder-aecb8645-a0e6-40c9-970d-1c9ada70776f-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:31 devstack sudo[115615]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340" returned: 0 in 0.362s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:31 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:31 devstack sudo[115621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c 1G
Aug 26 17:25:31 devstack sudo[115621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Flow 'volume_create_manager' (66469466-0b52-487d-8291-2f4f57c9b720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11698951-01f1-4b8e-afb5-9d0c9ed25f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11698951-01f1-4b8e-afb5-9d0c9ed25f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1835136528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b919b11f0244088037722f03a70359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:32Z,use_quota=True,user_id='9f9614662d444a57a46f71aa533a759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2ebb08-3ade-49f0-9af2-17f7342b92f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2ebb08-3ade-49f0-9af2-17f7342b92f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52ccddb-cb40-451d-9b64-38227b08fc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52ccddb-cb40-451d-9b64-38227b08fc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe', 'volume_name': 'volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67e33e8-7eac-4daf-bb66-83245f70f1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67e33e8-7eac-4daf-bb66-83245f70f1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b13ba8-2c0a-4bf7-8a15-ef8a5051071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:32 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Volume 3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe', 'volume_size': 1}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:32 devstack sudo[115621]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c 1G" returned: 0 in 0.404s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:32 devstack sudo[115627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c
Aug 26 17:25:32 devstack sudo[115627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:32 devstack sudo[115627]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c" returned: 0 in 0.300s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:32 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c is being set with open permissions: ugo+rw
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:32 devstack sudo[115633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c
Aug 26 17:25:32 devstack sudo[115633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:32 devstack sudo[115633]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c" returned: 0 in 0.237s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:32 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:32 devstack sudo[115636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.info
Aug 26 17:25:32 devstack sudo[115636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:33 devstack sudo[115636]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.info" returned: 0 in 0.239s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:33 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.info is being set with open permissions: ugo+rw
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:33 devstack sudo[115639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.info
Aug 26 17:25:33 devstack sudo[115639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:33 devstack sudo[115639]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.info" returned: 0 in 0.240s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.107s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1835136528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b919b11f0244088037722f03a70359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:32Z,use_quota=True,user_id='9f9614662d444a57a46f71aa533a759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Creating volume 3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:33 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:33 devstack sudo[115642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe 1073741824
Aug 26 17:25:33 devstack sudo[115642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:33 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c076f658-95a5-4780-bfd5-ac26c0f7bdf8 tempest-ProjectMemberTests-2141364931 None] Create snapshot completed successfully
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-5156d641-7140-48b3-91d5-cec643c6ec6c-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-5156d641-7140-48b3-91d5-cec643c6ec6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-d698ccd2-67c6-4c40-a44f-e54af8ab4340" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-d698ccd2-67c6-4c40-a44f-e54af8ab4340" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-5156d641-7140-48b3-91d5-cec643c6ec6c" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-5156d641-7140-48b3-91d5-cec643c6ec6c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Deleting offline snapshot 5156d641-7140-48b3-91d5-cec643c6ec6c of volume d698ccd2-67c6-4c40-a44f-e54af8ab4340 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] snapshot_file for this snap is: volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[23053f28-cf67-4b42-8a65-6861fadcc316]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:33 devstack sudo[115642]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe 1073741824" returned: 0 in 0.441s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:33 devstack sudo[115648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c
Aug 26 17:25:33 devstack sudo[115648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:33 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:33 devstack sudo[115650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe
Aug 26 17:25:33 devstack sudo[115650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:34 devstack sudo[115648]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c" returned: 0 in 0.363s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:25:34 devstack sudo[115650]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe" returned: 0 in 0.244s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e614d67b-2535-4217-822b-4d5b5f4fff66]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b13ba8-2c0a-4bf7-8a15-ef8a5051071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79391a51-ab44-4eac-9d8f-63141030de5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:34 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Volume volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe (3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe): created successfully
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79391a51-ab44-4eac-9d8f-63141030de5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Flow 'volume_create_manager' (66469466-0b52-487d-8291-2f4f57c9b720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:34 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7065166d-eecc-44eb-89df-b306efe6bcdf tempest-ProjectReaderTests-823288463 None] Created volume successfully.
Aug 26 17:25:34 devstack sudo[115656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340
Aug 26 17:25:34 devstack sudo[115656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:34 devstack sudo[115656]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340" returned: 0 in 0.349s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:34 devstack sudo[115661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c
Aug 26 17:25:34 devstack sudo[115661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:34 devstack sudo[115661]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c" returned: 0 in 0.314s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:34 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:34 devstack sudo[115666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c
Aug 26 17:25:34 devstack sudo[115666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:35 devstack sudo[115666]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340.5156d641-7140-48b3-91d5-cec643c6ec6c" returned: 0 in 0.230s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-5156d641-7140-48b3-91d5-cec643c6ec6c" released by "_delete_snapshot" :: held 1.341s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-d698ccd2-67c6-4c40-a44f-e54af8ab4340" released by "delete_snapshot" :: held 1.364s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Created reservations ['84710f91-fc67-434d-809c-77b6bd8add3c', '63666d4f-e748-4d5c-b2bc-1a0256b2e3cf', '2870a9ce-3d17-4658-a2c9-2d690e096c41', 'e5554ce4-4fdc-457d-b7d9-4eaedfa2c13d'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:35 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Delete snapshot completed successfully.
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ca091066-6e31-4fe4-a756-b5169cc99371 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-5156d641-7140-48b3-91d5-cec643c6ec6c-delete_snapshot" released by "delete_snapshot" :: held 1.493s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] Creating offline snapshot 19eac984-0fdd-4197-bdd1-2b987d352351 of volume 3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f3f5de-b885-4b86-9719-69c16da67a92]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:35 devstack sudo[115669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe
Aug 26 17:25:35 devstack sudo[115669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-d698ccd2-67c6-4c40-a44f-e54af8ab4340-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Lock "cinder-d698ccd2-67c6-4c40-a44f-e54af8ab4340-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-d698ccd2-67c6-4c40-a44f-e54af8ab4340" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:35 devstack sudo[115669]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe" returned: 0 in 0.379s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-d698ccd2-67c6-4c40-a44f-e54af8ab4340" acquired by "delete_volume" :: waited 0.027s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:35 devstack sudo[115675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351 1G
Aug 26 17:25:35 devstack sudo[115675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3135403-1921-44db-81c5-8f49804bd8da]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:35 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:36 devstack sudo[115677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340
Aug 26 17:25:36 devstack sudo[115677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:36 devstack sudo[115675]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351 1G" returned: 0 in 0.389s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:36 devstack sudo[115686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351
Aug 26 17:25:36 devstack sudo[115686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:36 devstack sudo[115677]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340" returned: 0 in 0.375s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:36 devstack sudo[115688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340
Aug 26 17:25:36 devstack sudo[115688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:36 devstack sudo[115686]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351" returned: 0 in 0.287s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:36 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351 is being set with open permissions: ugo+rw
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:36 devstack sudo[115688]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d698ccd2-67c6-4c40-a44f-e54af8ab4340" returned: 0 in 0.266s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:36 devstack sudo[115695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351
Aug 26 17:25:36 devstack sudo[115695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-d698ccd2-67c6-4c40-a44f-e54af8ab4340" released by "delete_volume" :: held 0.707s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Created reservations ['a71eba7c-01e4-43de-8986-4631bc11bdc9', 'e5da12b9-adad-4a15-9bdc-b6047807c461', '7500f792-d23e-4be0-8470-a5bf772463b5', '9ac73070-8e14-4487-8629-7f3455cb3606'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:36 devstack sudo[115697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:36 devstack sudo[115697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:36 devstack sudo[115695]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351" returned: 0 in 0.261s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:36 devstack sudo[115700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.info
Aug 26 17:25:36 devstack sudo[115700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:36 devstack sudo[115697]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.269s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:36 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:36 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Deleted volume successfully.
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-96a40a12-4448-44e9-8e29-86f0da4d1aba tempest-ProjectMemberTests-2141364931 None] Lock "cinder-d698ccd2-67c6-4c40-a44f-e54af8ab4340-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:37 devstack sudo[115700]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.info" returned: 0 in 0.264s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:37 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.info is being set with open permissions: ugo+rw
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:37 devstack sudo[115704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.info
Aug 26 17:25:37 devstack sudo[115704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:37 devstack sudo[115704]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.info" returned: 0 in 0.272s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (51db290b-1d17-49cd-b1cc-6e47a7bd50df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2698a217-ad76-42b0-ae47-435b84194bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-acd85ea7-221c-4645-bbb7-e5c1b29fb1de tempest-ProjectReaderTests-823288463 None] Create snapshot completed successfully
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2698a217-ad76-42b0-ae47-435b84194bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1551113024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8bec00e-3fa1-4238-9f7b-ac8520e59127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:37Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dde874d-9667-43a2-aade-405a8cb119a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dde874d-9667-43a2-aade-405a8cb119a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe74da96-f355-4554-96db-de95fe4dd73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe74da96-f355-4554-96db-de95fe4dd73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8bec00e-3fa1-4238-9f7b-ac8520e59127', 'volume_name': 'volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f4baf2-8d88-4961-b49d-eb7022c01212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f4baf2-8d88-4961-b49d-eb7022c01212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ca1dbd-f952-438d-9017-537fc2f7f955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:37 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Volume d8bec00e-3fa1-4238-9f7b-ac8520e59127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127', 'volume_size': 1}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1551113024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8bec00e-3fa1-4238-9f7b-ac8520e59127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:37Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Creating volume d8bec00e-3fa1-4238-9f7b-ac8520e59127 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:37 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:37 devstack sudo[115707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127 1073741824
Aug 26 17:25:37 devstack sudo[115707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-19eac984-0fdd-4197-bdd1-2b987d352351-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Lock "cinder-19eac984-0fdd-4197-bdd1-2b987d352351-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-19eac984-0fdd-4197-bdd1-2b987d352351" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-19eac984-0fdd-4197-bdd1-2b987d352351" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Deleting offline snapshot 19eac984-0fdd-4197-bdd1-2b987d352351 of volume 3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] snapshot_file for this snap is: volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb02717-1dc5-4d67-ad3e-687a77dee159]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:37 devstack sudo[115709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351
Aug 26 17:25:37 devstack sudo[115709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:37 devstack sudo[115707]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127 1073741824" returned: 0 in 0.409s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:37 devstack sudo[115716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127
Aug 26 17:25:37 devstack sudo[115716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:38 devstack sudo[115709]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351" returned: 0 in 0.352s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[5609a1d8-f3fe-4c0c-b760-269095d57ec2]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:38 devstack sudo[115720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe
Aug 26 17:25:38 devstack sudo[115720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:38 devstack sudo[115716]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127" returned: 0 in 0.235s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ca1dbd-f952-438d-9017-537fc2f7f955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8142502d-96de-49c4-a174-646bca4434ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:38 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Volume volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127 (d8bec00e-3fa1-4238-9f7b-ac8520e59127): created successfully
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8142502d-96de-49c4-a174-646bca4434ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (51db290b-1d17-49cd-b1cc-6e47a7bd50df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:38 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-4a8ea489-b012-4977-9c17-648d880b9eca tempest-ProjectMemberTests-2141364931 None] Created volume successfully.
Aug 26 17:25:38 devstack sudo[115720]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe" returned: 0 in 0.365s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:38 devstack sudo[115726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351
Aug 26 17:25:38 devstack sudo[115726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] Creating offline snapshot 96b8629c-8dc6-439f-a211-d7024ac04056 of volume d8bec00e-3fa1-4238-9f7b-ac8520e59127 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[8282c65f-2a1a-4f94-a5f6-1be53ba65bf0]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:38 devstack sudo[115729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127
Aug 26 17:25:38 devstack sudo[115729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:38 devstack sudo[115726]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351" returned: 0 in 0.348s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:38 devstack sudo[115734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351
Aug 26 17:25:38 devstack sudo[115734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:38 devstack sudo[115729]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127" returned: 0 in 0.371s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:39 devstack sudo[115742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056 1G
Aug 26 17:25:39 devstack sudo[115742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:39 devstack sudo[115734]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe.19eac984-0fdd-4197-bdd1-2b987d352351" returned: 0 in 0.264s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-19eac984-0fdd-4197-bdd1-2b987d352351" released by "_delete_snapshot" :: held 1.409s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe" released by "delete_snapshot" :: held 1.433s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Created reservations ['0491540c-af86-4468-b9fe-108f375e7a00', '1a9c25bf-f45b-40e9-bf7d-5fa334a5963f', '3fb85444-3dc3-4229-bc4a-7938fc93261d', 'c22d7ed8-7c01-4272-bb9b-d5667a87747d'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:39 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Delete snapshot completed successfully.
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-d01e0226-d94c-435d-b33b-34dad128b807 tempest-ProjectReaderTests-823288463 None] Lock "cinder-19eac984-0fdd-4197-bdd1-2b987d352351-delete_snapshot" released by "delete_snapshot" :: held 1.586s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:39 devstack sudo[115742]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056 1G" returned: 0 in 0.401s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:39 devstack sudo[115747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056
Aug 26 17:25:39 devstack sudo[115747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:39 devstack sudo[115747]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056" returned: 0 in 0.272s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:39 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056 is being set with open permissions: ugo+rw
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:39 devstack sudo[115752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056
Aug 26 17:25:39 devstack sudo[115752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Lock "cinder-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe" acquired by "delete_volume" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a86b96-4aa4-49a9-b7c4-1051011c5b54]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:39 devstack sudo[115752]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056" returned: 0 in 0.251s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:39 devstack sudo[115756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.info
Aug 26 17:25:39 devstack sudo[115756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:40 devstack sudo[115755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe
Aug 26 17:25:40 devstack sudo[115755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:40 devstack sudo[115756]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.info" returned: 0 in 0.250s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:40 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.info is being set with open permissions: ugo+rw
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:40 devstack sudo[115762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.info
Aug 26 17:25:40 devstack sudo[115762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:40 devstack sudo[115755]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe" returned: 0 in 0.366s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:40 devstack sudo[115765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe
Aug 26 17:25:40 devstack sudo[115765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:40 devstack sudo[115762]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.info" returned: 0 in 0.246s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:40 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-03642383-2669-4c11-9fd2-a18fbe41e5aa tempest-ProjectMemberTests-2141364931 None] Create snapshot completed successfully
Aug 26 17:25:40 devstack sudo[115765]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe" returned: 0 in 0.252s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe" released by "delete_volume" :: held 0.684s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Created reservations ['9a98f8f8-a25f-4966-928c-71c26b320a82', '59df02cc-8589-42b1-862d-f941a3bcae96', 'a5567fff-bd4a-4c92-9ea3-169dfe8b53c7', '515ae121-b215-4313-94a6-8bd2b2074ce1'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-96b8629c-8dc6-439f-a211-d7024ac04056-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:40 devstack sudo[115769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:40 devstack sudo[115769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-96b8629c-8dc6-439f-a211-d7024ac04056-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-d8bec00e-3fa1-4238-9f7b-ac8520e59127" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-d8bec00e-3fa1-4238-9f7b-ac8520e59127" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-96b8629c-8dc6-439f-a211-d7024ac04056" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-96b8629c-8dc6-439f-a211-d7024ac04056" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Deleting offline snapshot 96b8629c-8dc6-439f-a211-d7024ac04056 of volume d8bec00e-3fa1-4238-9f7b-ac8520e59127 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] snapshot_file for this snap is: volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc980cc-e77f-491b-9d3e-3158c57f4cae]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:40 devstack sudo[115771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056
Aug 26 17:25:40 devstack sudo[115771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:40 devstack sudo[115769]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.264s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:40 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:40 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Deleted volume successfully.
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a69be82-5dd2-421a-8bfb-0c87592998d5 tempest-ProjectReaderTests-823288463 None] Lock "cinder-3f0648c5-98b4-4fd3-a6df-5ff0c632d8fe-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:41 devstack sudo[115771]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056" returned: 0 in 0.409s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[b379200b-8215-490a-a669-e5377220b180]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:41 devstack sudo[115778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127
Aug 26 17:25:41 devstack sudo[115778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Flow 'volume_create_manager' (d3e282da-f941-4ba4-a8d5-33f201479fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beee1e9b-cc9e-47e0-88e7-ecd6aca649d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beee1e9b-cc9e-47e0-88e7-ecd6aca649d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123524809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb55fa81-e63d-49eb-994c-bb40877ffb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b919b11f0244088037722f03a70359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:41Z,use_quota=True,user_id='9f9614662d444a57a46f71aa533a759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2347f99c-cd51-48da-957b-6983246f75f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2347f99c-cd51-48da-957b-6983246f75f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e3b2f1-eec8-47a9-9692-275070d4953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e3b2f1-eec8-47a9-9692-275070d4953c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb55fa81-e63d-49eb-994c-bb40877ffb08', 'volume_name': 'volume-bb55fa81-e63d-49eb-994c-bb40877ffb08', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1087351-7b3f-493a-93e1-ebfbcf20086d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1087351-7b3f-493a-93e1-ebfbcf20086d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1408699d-ca65-41fc-bb4f-5ce634fa22db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:41 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Volume bb55fa81-e63d-49eb-994c-bb40877ffb08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb55fa81-e63d-49eb-994c-bb40877ffb08', 'volume_size': 1}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123524809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb55fa81-e63d-49eb-994c-bb40877ffb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b919b11f0244088037722f03a70359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:41Z,use_quota=True,user_id='9f9614662d444a57a46f71aa533a759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Creating volume bb55fa81-e63d-49eb-994c-bb40877ffb08 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:41 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:41 devstack sudo[115780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08 1073741824
Aug 26 17:25:41 devstack sudo[115780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:41 devstack sudo[115778]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127" returned: 0 in 0.369s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:41 devstack sudo[115785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056
Aug 26 17:25:41 devstack sudo[115785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:41 devstack sudo[115780]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08 1073741824" returned: 0 in 0.422s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:41 devstack sudo[115793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08
Aug 26 17:25:41 devstack sudo[115793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:41 devstack sudo[115785]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056" returned: 0 in 0.352s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:41 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:42 devstack sudo[115795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056
Aug 26 17:25:42 devstack sudo[115795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:42 devstack sudo[115793]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08" returned: 0 in 0.271s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:42 devstack sudo[115799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:42 devstack sudo[115799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1408699d-ca65-41fc-bb4f-5ce634fa22db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb55fa81-e63d-49eb-994c-bb40877ffb08', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c282b512-98a4-416b-a91a-fe9bf8aa7996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:42 devstack sudo[115795]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127.96b8629c-8dc6-439f-a211-d7024ac04056" returned: 0 in 0.249s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:42 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Volume volume-bb55fa81-e63d-49eb-994c-bb40877ffb08 (bb55fa81-e63d-49eb-994c-bb40877ffb08): created successfully
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c282b512-98a4-416b-a91a-fe9bf8aa7996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Flow 'volume_create_manager' (d3e282da-f941-4ba4-a8d5-33f201479fcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-96b8629c-8dc6-439f-a211-d7024ac04056" released by "_delete_snapshot" :: held 1.481s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-d8bec00e-3fa1-4238-9f7b-ac8520e59127" released by "delete_snapshot" :: held 1.511s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:42 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-27edb3e4-c21f-4dcb-9818-09621041fa3b tempest-ProjectReaderTests-823288463 None] Created volume successfully.
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Created reservations ['afe3703b-36e8-466a-adde-3b1a53b2c029', '4c57f4e7-df3c-4705-ba8f-bf1c977f3874', 'f59fb998-8745-42fa-9ae9-ab8dd9b6e9a8', 'b5be46a1-bd86-41d1-aa13-9bbc867d27a4'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:42 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Delete snapshot completed successfully.
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-3d37adae-1a66-401d-a3b5-b3e8a4198127 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-96b8629c-8dc6-439f-a211-d7024ac04056-delete_snapshot" released by "delete_snapshot" :: held 1.665s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:42 devstack sudo[115799]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.272s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 29 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>, <Thread(Rabbit-heartbeat, started daemon 133049442341056)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] Creating offline snapshot 72ead33b-d838-4d2e-8364-39cac4bc9d34 of volume bb55fa81-e63d-49eb-994c-bb40877ffb08 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef85895-1ff2-441e-9ef6-02d50646a9a0]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:42 devstack sudo[115802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08
Aug 26 17:25:42 devstack sudo[115802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-d8bec00e-3fa1-4238-9f7b-ac8520e59127-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-d8bec00e-3fa1-4238-9f7b-ac8520e59127-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-d8bec00e-3fa1-4238-9f7b-ac8520e59127" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:42 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-d8bec00e-3fa1-4238-9f7b-ac8520e59127" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:43 devstack sudo[115802]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08" returned: 0 in 0.395s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b1d026-8810-4758-8cf0-ce4755dd8226]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:43 devstack sudo[115807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34 1G
Aug 26 17:25:43 devstack sudo[115807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:43 devstack sudo[115808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127
Aug 26 17:25:43 devstack sudo[115808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:43 devstack sudo[115808]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127" returned: 0 in 0.382s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:43 devstack sudo[115817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127
Aug 26 17:25:43 devstack sudo[115817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:43 devstack sudo[115807]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34 1G" returned: 0 in 0.424s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb55fa81-e63d-49eb-994c-bb40877ffb08 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:43 devstack sudo[115819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb55fa81-e63d-49eb-994c-bb40877ffb08 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34
Aug 26 17:25:43 devstack sudo[115819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:43 devstack sudo[115817]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d8bec00e-3fa1-4238-9f7b-ac8520e59127" returned: 0 in 0.243s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-d8bec00e-3fa1-4238-9f7b-ac8520e59127" released by "delete_volume" :: held 0.690s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Created reservations ['023b603d-6e60-40ad-bc3f-bddef15aa7f2', '8ea8fa9a-9de7-44f0-8ea6-28b2ebc99ede', 'baa3f175-af49-45fe-91b4-a2d54db5e54a', '06d5ed0d-f8b1-4e1d-a404-7c560ac6d0ce'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:43 devstack sudo[115819]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb55fa81-e63d-49eb-994c-bb40877ffb08 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34" returned: 0 in 0.289s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:43 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34 is being set with open permissions: ugo+rw
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:43 devstack sudo[115825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34
Aug 26 17:25:43 devstack sudo[115825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:43 devstack sudo[115827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:43 devstack sudo[115827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:43 devstack sudo[115825]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34" returned: 0 in 0.242s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:43 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:44 devstack sudo[115831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.info
Aug 26 17:25:44 devstack sudo[115831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:44 devstack sudo[115827]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.248s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Deleted volume successfully.
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7a0b1a2d-3acb-4553-9673-8b51a1c463b2 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-d8bec00e-3fa1-4238-9f7b-ac8520e59127-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:44 devstack sudo[115831]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.info" returned: 0 in 0.264s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:44 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.info is being set with open permissions: ugo+rw
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:44 devstack sudo[115834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.info
Aug 26 17:25:44 devstack sudo[115834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:44 devstack sudo[115834]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (7cda779d-2954-4a1c-a722-cb687cf06870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02cb319-ada6-4166-b595-935e5a8392dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.info" returned: 0 in 0.283s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02cb319-ada6-4166-b595-935e5a8392dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130088599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:44Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4aed63-92aa-4ed5-880a-dead61bcaa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4aed63-92aa-4ed5-880a-dead61bcaa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e08dc40-a5ab-4faa-945c-820de919f3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e08dc40-a5ab-4faa-945c-820de919f3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f', 'volume_name': 'volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe35deb-6390-4489-9a23-c08648fc4ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe35deb-6390-4489-9a23-c08648fc4ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c29a34-6ae3-45d1-8dc1-fb3bdba1601b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:44 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Volume 5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f', 'volume_size': 1}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130088599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:44Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Creating volume 5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:44 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:44 devstack sudo[115837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f 1073741824
Aug 26 17:25:44 devstack sudo[115837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:44 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-bd46c31d-702d-47d2-9bb4-8daa0ce1275f tempest-ProjectReaderTests-823288463 None] Create snapshot completed successfully
Aug 26 17:25:45 devstack sudo[115837]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f 1073741824" returned: 0 in 0.417s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:45 devstack sudo[115842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f
Aug 26 17:25:45 devstack sudo[115842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:45 devstack sudo[115842]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f" returned: 0 in 0.251s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c29a34-6ae3-45d1-8dc1-fb3bdba1601b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68f5deb-c16d-4c09-8913-c8681a1955d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:45 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Volume volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f (5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f): created successfully
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68f5deb-c16d-4c09-8913-c8681a1955d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (7cda779d-2954-4a1c-a722-cb687cf06870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-1ae906cf-0f6d-45af-9c14-99e8b80e39b9 tempest-ProjectMemberTests-2141364931 None] Created volume successfully.
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] Creating offline snapshot 27b5bef8-b5dc-4b88-aac9-a43067271d94 of volume 5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[2166975b-3db7-439f-95e3-c66c95a3602c]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-72ead33b-d838-4d2e-8364-39cac4bc9d34-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Lock "cinder-72ead33b-d838-4d2e-8364-39cac4bc9d34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-bb55fa81-e63d-49eb-994c-bb40877ffb08" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-bb55fa81-e63d-49eb-994c-bb40877ffb08" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-72ead33b-d838-4d2e-8364-39cac4bc9d34" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-72ead33b-d838-4d2e-8364-39cac4bc9d34" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Deleting offline snapshot 72ead33b-d838-4d2e-8364-39cac4bc9d34 of volume bb55fa81-e63d-49eb-994c-bb40877ffb08 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:25:45 devstack sudo[115845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f
Aug 26 17:25:45 devstack sudo[115845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] snapshot_file for this snap is: volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e32a9e-77a8-4e0d-8da5-b9d8cce239df]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:45 devstack sudo[115847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34
Aug 26 17:25:45 devstack sudo[115847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:46 devstack sudo[115845]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f" returned: 0 in 0.354s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:46 devstack sudo[115852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94 1G
Aug 26 17:25:46 devstack sudo[115852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:46 devstack sudo[115847]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34" returned: 0 in 0.373s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb55fa81-e63d-49eb-994c-bb40877ffb08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a025a51-0121-4488-8995-b2d481b6dc85]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:46 devstack sudo[115857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08
Aug 26 17:25:46 devstack sudo[115857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:46 devstack sudo[115852]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94 1G" returned: 0 in 0.411s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:46 devstack sudo[115862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94
Aug 26 17:25:46 devstack sudo[115862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:46 devstack sudo[115857]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08" returned: 0 in 0.379s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:46 devstack sudo[115868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34
Aug 26 17:25:46 devstack sudo[115868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:46 devstack sudo[115862]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94" returned: 0 in 0.300s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:46 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94 is being set with open permissions: ugo+rw
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:46 devstack sudo[115873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94
Aug 26 17:25:46 devstack sudo[115873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:46 devstack sudo[115868]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34" returned: 0 in 0.355s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:46 devstack sudo[115878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34
Aug 26 17:25:46 devstack sudo[115878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:47 devstack sudo[115873]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94" returned: 0 in 0.255s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:47 devstack sudo[115881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.info
Aug 26 17:25:47 devstack sudo[115881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:47 devstack sudo[115878]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08.72ead33b-d838-4d2e-8364-39cac4bc9d34" returned: 0 in 0.241s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-72ead33b-d838-4d2e-8364-39cac4bc9d34" released by "_delete_snapshot" :: held 1.447s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-bb55fa81-e63d-49eb-994c-bb40877ffb08" released by "delete_snapshot" :: held 1.471s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:47 devstack sudo[115881]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.info" returned: 0 in 0.262s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:47 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.info is being set with open permissions: ugo+rw
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Created reservations ['1faa6e6b-1d82-45a0-beae-86c27228604d', '35431a86-4a7c-4bf9-98c5-8c017c33fdbc', 'ac6cc147-50d7-4961-92b4-83b7139470a6', '88899497-ec5a-4132-b361-ee4c048c248a'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:47 devstack sudo[115885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.info
Aug 26 17:25:47 devstack sudo[115885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:47 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Delete snapshot completed successfully.
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-ded7dca9-4cd1-4c61-a383-6a32f353ef42 tempest-ProjectReaderTests-823288463 None] Lock "cinder-72ead33b-d838-4d2e-8364-39cac4bc9d34-delete_snapshot" released by "delete_snapshot" :: held 1.615s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:47 devstack sudo[115885]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.info" returned: 0 in 0.248s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:47 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-77327d95-1d9c-4cd6-87ab-2c7d11087f0f tempest-ProjectMemberTests-2141364931 None] Create snapshot completed successfully
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-27b5bef8-b5dc-4b88-aac9-a43067271d94-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-27b5bef8-b5dc-4b88-aac9-a43067271d94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-27b5bef8-b5dc-4b88-aac9-a43067271d94" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-27b5bef8-b5dc-4b88-aac9-a43067271d94" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Deleting offline snapshot 27b5bef8-b5dc-4b88-aac9-a43067271d94 of volume 5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] snapshot_file for this snap is: volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[7618f720-0b84-472e-91d6-15cc808b27d0]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-bb55fa81-e63d-49eb-994c-bb40877ffb08-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Lock "cinder-bb55fa81-e63d-49eb-994c-bb40877ffb08-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-bb55fa81-e63d-49eb-994c-bb40877ffb08" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:47 devstack sudo[115888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94
Aug 26 17:25:47 devstack sudo[115888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-bb55fa81-e63d-49eb-994c-bb40877ffb08" acquired by "delete_volume" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce867df-266c-4f7d-b0a6-5c792807af43]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:48 devstack sudo[115890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08
Aug 26 17:25:48 devstack sudo[115890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:48 devstack sudo[115888]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94" returned: 0 in 0.363s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c94d970-5c9e-4af3-8132-392056a5bd6e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:48 devstack sudo[115895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f
Aug 26 17:25:48 devstack sudo[115895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:48 devstack sudo[115890]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08" returned: 0 in 0.370s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:48 devstack sudo[115900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08
Aug 26 17:25:48 devstack sudo[115900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:48 devstack sudo[115895]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f" returned: 0 in 0.370s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:48 devstack sudo[115900]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-bb55fa81-e63d-49eb-994c-bb40877ffb08" returned: 0 in 0.252s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:48 devstack sudo[115906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94
Aug 26 17:25:48 devstack sudo[115906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-bb55fa81-e63d-49eb-994c-bb40877ffb08" released by "delete_volume" :: held 0.682s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Created reservations ['a1ad4d7d-a3cb-43db-8b28-2a275be1c54b', 'e2358241-4d37-4119-88b2-92bca20f698d', '86d1360a-f151-43b6-9286-169b2600852c', '95ab07a3-6e3a-434f-a3cb-daa7fd472e94'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:48 devstack sudo[115908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:48 devstack sudo[115908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:48 devstack sudo[115906]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94" returned: 0 in 0.334s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:49 devstack sudo[115913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94
Aug 26 17:25:49 devstack sudo[115913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:49 devstack sudo[115908]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.245s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:49 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Deleted volume successfully.
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2e04f46c-e8d3-46e9-82b8-9ffab91bdc4a tempest-ProjectReaderTests-823288463 None] Lock "cinder-bb55fa81-e63d-49eb-994c-bb40877ffb08-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:49 devstack sudo[115913]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f.27b5bef8-b5dc-4b88-aac9-a43067271d94" returned: 0 in 0.260s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-27b5bef8-b5dc-4b88-aac9-a43067271d94" released by "_delete_snapshot" :: held 1.421s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f" released by "delete_snapshot" :: held 1.445s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Created reservations ['fc4f0312-d193-43a9-aaa5-2369223c11e4', '42e355af-b483-4b5e-8330-aa8dffb997aa', '6ce77410-7f48-496b-8bc5-edaeae154f6a', '9ff1b872-77c4-429e-ab01-a29f44c94528'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:49 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Delete snapshot completed successfully.
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-f5512a19-a10b-4998-904a-e41b84adf51f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-27b5bef8-b5dc-4b88-aac9-a43067271d94-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Flow 'volume_create_manager' (962f322c-e43b-4b8b-8149-496124bf3760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ca7586-fbab-4080-94ec-e15c66ac9fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ca7586-fbab-4080-94ec-e15c66ac9fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510273448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b79592-6bb8-4993-81b4-8b8525844056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b919b11f0244088037722f03a70359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:50Z,use_quota=True,user_id='9f9614662d444a57a46f71aa533a759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ce5900-c5cd-491a-935c-61525004a41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ce5900-c5cd-491a-935c-61525004a41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200f8a29-8051-499d-bcbd-baeb79946fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200f8a29-8051-499d-bcbd-baeb79946fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b79592-6bb8-4993-81b4-8b8525844056', 'volume_name': 'volume-29b79592-6bb8-4993-81b4-8b8525844056', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76414432-21f5-4e48-8325-ca78e0e880b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76414432-21f5-4e48-8325-ca78e0e880b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2534f8f-57e7-451e-b445-531bb3ae2c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:49 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Volume 29b79592-6bb8-4993-81b4-8b8525844056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b79592-6bb8-4993-81b4-8b8525844056', 'volume_size': 1}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510273448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b79592-6bb8-4993-81b4-8b8525844056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b919b11f0244088037722f03a70359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:50Z,use_quota=True,user_id='9f9614662d444a57a46f71aa533a759a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Creating volume 29b79592-6bb8-4993-81b4-8b8525844056 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:49 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:49 devstack sudo[115917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056 1073741824
Aug 26 17:25:49 devstack sudo[115917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f" acquired by "delete_volume" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d764ccdb-c48b-47c7-b10e-248f78890d70]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:50 devstack sudo[115917]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056 1073741824" returned: 0 in 0.463s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:50 devstack sudo[115924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056
Aug 26 17:25:50 devstack sudo[115924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:50 devstack sudo[115923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f
Aug 26 17:25:50 devstack sudo[115923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:50 devstack sudo[115924]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056" returned: 0 in 0.244s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2534f8f-57e7-451e-b445-531bb3ae2c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b79592-6bb8-4993-81b4-8b8525844056', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb040a7a-7cef-4081-b4af-5c9facac13ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:50 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Volume volume-29b79592-6bb8-4993-81b4-8b8525844056 (29b79592-6bb8-4993-81b4-8b8525844056): created successfully
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb040a7a-7cef-4081-b4af-5c9facac13ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Flow 'volume_create_manager' (962f322c-e43b-4b8b-8149-496124bf3760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:50 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-85208464-51f8-4912-9fcf-1e266e677fbf tempest-ProjectReaderTests-823288463 None] Created volume successfully.
Aug 26 17:25:50 devstack sudo[115923]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f" returned: 0 in 0.366s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:50 devstack sudo[115931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f
Aug 26 17:25:50 devstack sudo[115931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:50 devstack sudo[115931]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f" returned: 0 in 0.274s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f" released by "delete_volume" :: held 0.696s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] Creating offline snapshot 071a6238-0236-4085-a2d4-294e43cadb59 of volume 29b79592-6bb8-4993-81b4-8b8525844056 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[0171fa76-6fbc-467c-a0bc-b3cc839828d1]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Created reservations ['90e9dd19-a00c-413d-bca7-621af0cc7325', '9fc88193-e96f-4198-90f2-251001fa5be6', '6cf371aa-5a36-4f5a-8b80-920fa47e4e74', 'cf656e9a-f5f2-49be-bb51-ac791906e36a'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:50 devstack sudo[115934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056
Aug 26 17:25:50 devstack sudo[115934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:50 devstack sudo[115936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:50 devstack sudo[115936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:51 devstack sudo[115934]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056" returned: 0 in 0.363s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:51 devstack sudo[115936]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.261s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:51 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Deleted volume successfully.
Aug 26 17:25:51 devstack sudo[115943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59 1G
Aug 26 17:25:51 devstack sudo[115943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-a000693c-cff8-4169-b5b8-ba22a17a763f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-5fca3fd0-2e5b-47fd-b066-1e62c90a1a4f-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:51 devstack sudo[115943]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59 1G" returned: 0 in 0.430s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29b79592-6bb8-4993-81b4-8b8525844056 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:51 devstack sudo[115949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29b79592-6bb8-4993-81b4-8b8525844056 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59
Aug 26 17:25:51 devstack sudo[115949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (20725f4c-55c9-4cab-8cfb-18fcf60ae015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e92027-d71d-417d-8c19-a27da35380b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e92027-d71d-417d-8c19-a27da35380b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096840341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f5388b-4566-4760-a487-44295314a4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:52Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e996d5fb-fdc5-4568-8a3a-259ae5ebeacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e996d5fb-fdc5-4568-8a3a-259ae5ebeacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df95eb23-528d-4f6d-a998-723504b0e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df95eb23-528d-4f6d-a998-723504b0e766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f5388b-4566-4760-a487-44295314a4f6', 'volume_name': 'volume-35f5388b-4566-4760-a487-44295314a4f6', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba16eb6f-5ef5-499b-8dfc-99e04f30630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba16eb6f-5ef5-499b-8dfc-99e04f30630a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bc8e33-34d8-449c-b817-5e8e14d0309f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:51 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Volume 35f5388b-4566-4760-a487-44295314a4f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f5388b-4566-4760-a487-44295314a4f6', 'volume_size': 1}
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:51 devstack sudo[115949]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29b79592-6bb8-4993-81b4-8b8525844056 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59" returned: 0 in 0.292s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:51 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59 is being set with open permissions: ugo+rw
Aug 26 17:25:51 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:51 devstack sudo[115954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59
Aug 26 17:25:51 devstack sudo[115954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:52 devstack sudo[115954]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59" returned: 0 in 0.241s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:52 devstack sudo[115957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.info
Aug 26 17:25:52 devstack sudo[115957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:52 devstack sudo[115957]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.info" returned: 0 in 0.252s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:52 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.info is being set with open permissions: ugo+rw
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:52 devstack sudo[115960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.info
Aug 26 17:25:52 devstack sudo[115960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:52 devstack sudo[115960]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.info" returned: 0 in 0.248s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.949s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096840341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f5388b-4566-4760-a487-44295314a4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:25:52Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Creating volume 35f5388b-4566-4760-a487-44295314a4f6 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:52 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:52 devstack sudo[115963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6 1073741824
Aug 26 17:25:52 devstack sudo[115963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:52 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-820b961c-578c-4d3a-ace0-ae5b5014b475 tempest-ProjectReaderTests-823288463 None] Create snapshot completed successfully
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-071a6238-0236-4085-a2d4-294e43cadb59-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Lock "cinder-071a6238-0236-4085-a2d4-294e43cadb59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-29b79592-6bb8-4993-81b4-8b8525844056" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-29b79592-6bb8-4993-81b4-8b8525844056" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-071a6238-0236-4085-a2d4-294e43cadb59" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-071a6238-0236-4085-a2d4-294e43cadb59" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Deleting offline snapshot 071a6238-0236-4085-a2d4-294e43cadb59 of volume 29b79592-6bb8-4993-81b4-8b8525844056 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] snapshot_file for this snap is: volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d56a8b-0e7c-499c-9079-63d93447c84b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:52 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:53 devstack sudo[115968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59
Aug 26 17:25:53 devstack sudo[115968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:53 devstack sudo[115963]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6 1073741824" returned: 0 in 0.449s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:53 devstack sudo[115970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6
Aug 26 17:25:53 devstack sudo[115970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:53 devstack sudo[115968]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59" returned: 0 in 0.374s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29b79592-6bb8-4993-81b4-8b8525844056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b435e3-a78f-499c-962d-d01d22dc5d58]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:53 devstack sudo[115970]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6" returned: 0 in 0.271s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bc8e33-34d8-449c-b817-5e8e14d0309f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f5388b-4566-4760-a487-44295314a4f6', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb59475-8d47-4dda-8bcc-de3aa3ba1e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:53 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Volume volume-35f5388b-4566-4760-a487-44295314a4f6 (35f5388b-4566-4760-a487-44295314a4f6): created successfully
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb59475-8d47-4dda-8bcc-de3aa3ba1e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (20725f4c-55c9-4cab-8cfb-18fcf60ae015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:53 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6e664235-92cd-4281-9c8a-2131a71891a2 tempest-ProjectMemberTests-2141364931 None] Created volume successfully.
Aug 26 17:25:53 devstack sudo[115975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056
Aug 26 17:25:53 devstack sudo[115975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:53 devstack sudo[115975]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056" returned: 0 in 0.393s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:53 devstack sudo[115981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59
Aug 26 17:25:53 devstack sudo[115981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] Creating offline snapshot ce34bf53-2e30-4e9b-8b78-c4b8d74434fd of volume 35f5388b-4566-4760-a487-44295314a4f6 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a76913-bb5d-412e-90f6-75e449895b10]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:53 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:53 devstack sudo[115983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6
Aug 26 17:25:53 devstack sudo[115983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:54 devstack sudo[115981]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59" returned: 0 in 0.353s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:54 devstack sudo[115988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59
Aug 26 17:25:54 devstack sudo[115988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:54 devstack sudo[115983]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6" returned: 0 in 0.375s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:54 devstack sudo[115993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd 1G
Aug 26 17:25:54 devstack sudo[115993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:54 devstack sudo[115988]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056.071a6238-0236-4085-a2d4-294e43cadb59" returned: 0 in 0.252s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-071a6238-0236-4085-a2d4-294e43cadb59" released by "_delete_snapshot" :: held 1.468s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-29b79592-6bb8-4993-81b4-8b8525844056" released by "delete_snapshot" :: held 1.494s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Created reservations ['cafbb62d-4a11-4d0c-a207-5b527fe40148', 'c1ee0ae4-b1c4-4bd6-a677-3d7cae5eb029', '32c65637-cb22-4de7-a45c-ffe515c0a402', 'bd8b30a5-d282-4ae4-96fb-940e98476806'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:54 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Delete snapshot completed successfully.
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-2bd5b5d5-a706-4fa9-8961-7a8065b07f4a tempest-ProjectReaderTests-823288463 None] Lock "cinder-071a6238-0236-4085-a2d4-294e43cadb59-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:54 devstack sudo[115993]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd 1G" returned: 0 in 0.425s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f5388b-4566-4760-a487-44295314a4f6 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:54 devstack sudo[116000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f5388b-4566-4760-a487-44295314a4f6 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd
Aug 26 17:25:54 devstack sudo[116000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:54 devstack sudo[116000]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f5388b-4566-4760-a487-44295314a4f6 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd" returned: 0 in 0.295s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:54 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd is being set with open permissions: ugo+rw
Aug 26 17:25:54 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:54 devstack sudo[116005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd
Aug 26 17:25:54 devstack sudo[116005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-29b79592-6bb8-4993-81b4-8b8525844056-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Lock "cinder-29b79592-6bb8-4993-81b4-8b8525844056-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Acquiring lock "cinder-quobyte-29b79592-6bb8-4993-81b4-8b8525844056" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-29b79592-6bb8-4993-81b4-8b8525844056" acquired by "delete_volume" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd9bc7f-c68a-4407-954a-ca984108e3bd]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:55 devstack sudo[116005]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd" returned: 0 in 0.275s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:55 devstack sudo[116007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056
Aug 26 17:25:55 devstack sudo[116007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:55 devstack sudo[116010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.info
Aug 26 17:25:55 devstack sudo[116010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:55 devstack sudo[116010]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.info" returned: 0 in 0.251s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:55 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.info is being set with open permissions: ugo+rw
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:55 devstack sudo[116007]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056" returned: 0 in 0.392s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:55 devstack sudo[116016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.info
Aug 26 17:25:55 devstack sudo[116016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:55 devstack sudo[116018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056
Aug 26 17:25:55 devstack sudo[116018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:55 devstack sudo[116016]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.info" returned: 0 in 0.254s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:55 devstack sudo[116018]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-29b79592-6bb8-4993-81b4-8b8525844056" returned: 0 in 0.268s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Lock "cinder-quobyte-29b79592-6bb8-4993-81b4-8b8525844056" released by "delete_volume" :: held 0.721s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:55 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-d4477353-a7de-4bfa-a212-04479fad06bb tempest-ProjectMemberTests-2141364931 None] Create snapshot completed successfully
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Created reservations ['4bf06e2e-2713-4837-9828-e6cfe521f6f4', 'cfc4a4ad-f35a-4fbc-936c-9b80e5add47e', '0c8b1a30-d802-4cbc-be94-696ca83a33f4', '31a8cfd2-537b-46ae-9333-139ade149bbc'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-ce34bf53-2e30-4e9b-8b78-c4b8d74434fd-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:55 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Lock "cinder-ce34bf53-2e30-4e9b-8b78-c4b8d74434fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-35f5388b-4566-4760-a487-44295314a4f6" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:56 devstack sudo[116022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:56 devstack sudo[116022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-35f5388b-4566-4760-a487-44295314a4f6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-ce34bf53-2e30-4e9b-8b78-c4b8d74434fd" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-ce34bf53-2e30-4e9b-8b78-c4b8d74434fd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Deleting offline snapshot ce34bf53-2e30-4e9b-8b78-c4b8d74434fd of volume 35f5388b-4566-4760-a487-44295314a4f6 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] snapshot_file for this snap is: volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d38a94-1b25-4c84-9b1d-781feaa9906e]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:56 devstack sudo[116024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd
Aug 26 17:25:56 devstack sudo[116024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:56 devstack sudo[116022]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.284s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:56 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Deleted volume successfully.
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-c5b3587c-d806-40ef-8a29-2c2eaf0441fa tempest-ProjectReaderTests-823288463 None] Lock "cinder-29b79592-6bb8-4993-81b4-8b8525844056-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:56 devstack sudo[116024]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd" returned: 0 in 0.416s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35f5388b-4566-4760-a487-44295314a4f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf392f44-5ebe-4fb1-b74d-cef2d5cbd435]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:56 devstack sudo[116030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6
Aug 26 17:25:56 devstack sudo[116030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:56 devstack sudo[116030]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6" returned: 0 in 0.377s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:56 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:56 devstack sudo[116036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd
Aug 26 17:25:56 devstack sudo[116036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:57 devstack sudo[116036]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd" returned: 0 in 0.387s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:57 devstack sudo[116041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd
Aug 26 17:25:57 devstack sudo[116041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:57 devstack sudo[116041]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:57 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6.ce34bf53-2e30-4e9b-8b78-c4b8d74434fd" returned: 0 in 0.285s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-ce34bf53-2e30-4e9b-8b78-c4b8d74434fd" released by "_delete_snapshot" :: held 1.576s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-35f5388b-4566-4760-a487-44295314a4f6" released by "delete_snapshot" :: held 1.599s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:57 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Created reservations ['e6b285dc-4441-4620-b722-49e8aea2a852', '88a4f05c-1791-42c1-bfaf-f68a5b6967bd', 'e4478915-8b94-4fb0-a78a-8497b9d90f29', '98b54a5c-413f-4bf1-9c2c-a74e40aa4a02'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:57 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Delete snapshot completed successfully.
Aug 26 17:25:57 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-cdcaed0d-7c04-42e4-8d2c-52c0ac553b8c tempest-ProjectMemberTests-2141364931 None] Lock "cinder-ce34bf53-2e30-4e9b-8b78-c4b8d74434fd-delete_snapshot" released by "delete_snapshot" :: held 1.741s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-35f5388b-4566-4760-a487-44295314a4f6-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-35f5388b-4566-4760-a487-44295314a4f6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-35f5388b-4566-4760-a487-44295314a4f6" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-35f5388b-4566-4760-a487-44295314a4f6" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0a2b14-21bc-4487-bee8-835b1eb50f21]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:58 devstack sudo[116044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6
Aug 26 17:25:58 devstack sudo[116044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:58 devstack sudo[116044]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6" returned: 0 in 0.398s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:58 devstack sudo[116049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6
Aug 26 17:25:58 devstack sudo[116049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:58 devstack sudo[116049]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-35f5388b-4566-4760-a487-44295314a4f6" returned: 0 in 0.264s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-35f5388b-4566-4760-a487-44295314a4f6" released by "delete_volume" :: held 0.730s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=200,cinder:INSERT=84,cinder:UPDATE=317,cinder:DELETE=20 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=247,cinder:UPDATE=275,cinder:DELETE=29,cinder:INSERT=74 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:25:58 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Created reservations ['c794ba76-fbd3-4a6b-baec-aaa25c5d8628', '8e1c72c8-6ae1-4ebf-b21a-f0fa1fc37649', '03b0d711-abd8-4e17-a205-81eee2649301', '0bb35deb-28b0-4caf-a40f-6e3dfdda2733'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:59 devstack sudo[116052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:25:59 devstack sudo[116052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:25:59 devstack sudo[116052]: pam_unix(sudo:session): session closed for user root
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.278s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:25:59 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Deleted volume successfully.
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7f5a7bb9-5d6c-4d0b-82d2-bbeeb96a4b0f tempest-ProjectMemberTests-2141364931 None] Lock "cinder-35f5388b-4566-4760-a487-44295314a4f6-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (64d745c1-b114-4425-a25b-d7f0f7b3f052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9988e3bd-d0a9-4a5e-97b7-cbe3f78b8f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9988e3bd-d0a9-4a5e-97b7-cbe3f78b8f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1635299327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e69892-a17e-4755-842f-b8318566accd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:26:00Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddbaf67-72fd-46dc-b47a-a67e0b4c8b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddbaf67-72fd-46dc-b47a-a67e0b4c8b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65558f7c-8859-454b-8cb7-fa9e542acf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65558f7c-8859-454b-8cb7-fa9e542acf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e69892-a17e-4755-842f-b8318566accd', 'volume_name': 'volume-e4e69892-a17e-4755-842f-b8318566accd', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df961e2f-e4a8-46ca-be2b-27edff2e9e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df961e2f-e4a8-46ca-be2b-27edff2e9e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc4fdd8-4358-4164-ac02-d89d3cca936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:25:59 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Volume e4e69892-a17e-4755-842f-b8318566accd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e69892-a17e-4755-842f-b8318566accd', 'volume_size': 1}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1635299327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e69892-a17e-4755-842f-b8318566accd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33701a9b241243f29a2f9562e4365c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:26:00Z,use_quota=True,user_id='bfb7d6e1a84244f4aec01b69a75343d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Creating volume e4e69892-a17e-4755-842f-b8318566accd {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:25:59 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:25:59 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:25:59 devstack sudo[116055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd 1073741824
Aug 26 17:25:59 devstack sudo[116055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:00 devstack sudo[116055]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd 1073741824" returned: 0 in 0.458s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:00 devstack sudo[116061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd
Aug 26 17:26:00 devstack sudo[116061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:00 devstack sudo[116061]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd" returned: 0 in 0.246s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:26:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:26:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc4fdd8-4358-4164-ac02-d89d3cca936a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e69892-a17e-4755-842f-b8318566accd', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210924c0-fb2e-4537-a49f-7a7f96850776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:00 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Volume volume-e4e69892-a17e-4755-842f-b8318566accd (e4e69892-a17e-4755-842f-b8318566accd): created successfully
Aug 26 17:26:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210924c0-fb2e-4537-a49f-7a7f96850776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:00 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Flow 'volume_create_manager' (64d745c1-b114-4425-a25b-d7f0f7b3f052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:26:00 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-08294bfa-4778-4618-92bd-00bba5f0011b tempest-ProjectMemberTests-2141364931 None] Created volume successfully.
Aug 26 17:26:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:26:00 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:26:00 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] Creating offline snapshot 32926344-b157-47b1-975b-7f8db00c88ef of volume e4e69892-a17e-4755-842f-b8318566accd {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:26:01 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52a9413-7b14-4fde-9c6f-9278d97172b5]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:26:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:01 devstack sudo[116064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd
Aug 26 17:26:01 devstack sudo[116064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:01 devstack sudo[116064]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd" returned: 0 in 0.357s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:01 devstack sudo[116069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef 1G
Aug 26 17:26:01 devstack sudo[116069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:01 devstack sudo[116069]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef 1G" returned: 0 in 0.443s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:01 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4e69892-a17e-4755-842f-b8318566accd -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:01 devstack sudo[116075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4e69892-a17e-4755-842f-b8318566accd -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef
Aug 26 17:26:01 devstack sudo[116075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:02 devstack sudo[116075]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4e69892-a17e-4755-842f-b8318566accd -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef" returned: 0 in 0.300s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:02 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef is being set with open permissions: ugo+rw
Aug 26 17:26:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:02 devstack sudo[116080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef
Aug 26 17:26:02 devstack sudo[116080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:02 devstack sudo[116080]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef" returned: 0 in 0.272s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:02 devstack sudo[116083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.info
Aug 26 17:26:02 devstack sudo[116083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:02 devstack sudo[116083]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.info" returned: 0 in 0.240s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:02 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.info is being set with open permissions: ugo+rw
Aug 26 17:26:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:02 devstack sudo[116086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.info
Aug 26 17:26:02 devstack sudo[116086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:02 devstack sudo[116086]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.info" returned: 0 in 0.236s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:02 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:26:02 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-ab5a9453-bdf4-4ae3-9d00-29e589d6a30d tempest-ProjectMemberTests-2141364931 None] Create snapshot completed successfully
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-32926344-b157-47b1-975b-7f8db00c88ef-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-32926344-b157-47b1-975b-7f8db00c88ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-e4e69892-a17e-4755-842f-b8318566accd" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-e4e69892-a17e-4755-842f-b8318566accd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-32926344-b157-47b1-975b-7f8db00c88ef" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-32926344-b157-47b1-975b-7f8db00c88ef" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Deleting offline snapshot 32926344-b157-47b1-975b-7f8db00c88ef of volume e4e69892-a17e-4755-842f-b8318566accd {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] snapshot_file for this snap is: volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b4fb63-4591-4eb4-9a76-b43524301b43]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:03 devstack sudo[116090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef
Aug 26 17:26:03 devstack sudo[116090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:03 devstack sudo[116090]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef" returned: 0 in 0.400s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4e69892-a17e-4755-842f-b8318566accd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[653d8920-6511-44aa-b785-8b770116b898]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:26:03 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:03 devstack sudo[116095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd
Aug 26 17:26:03 devstack sudo[116095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:04 devstack sudo[116095]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd" returned: 0 in 0.409s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:04 devstack sudo[116100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef
Aug 26 17:26:04 devstack sudo[116100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:04 devstack sudo[116100]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef" returned: 0 in 0.366s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:04 devstack sudo[116105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef
Aug 26 17:26:04 devstack sudo[116105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:04 devstack sudo[116105]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:04 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd.32926344-b157-47b1-975b-7f8db00c88ef" returned: 0 in 0.273s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-32926344-b157-47b1-975b-7f8db00c88ef" released by "_delete_snapshot" :: held 1.557s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:04 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-e4e69892-a17e-4755-842f-b8318566accd" released by "delete_snapshot" :: held 1.580s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:04 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Created reservations ['ec26e6c4-2b4d-4e61-98e8-2cfa4fc848f8', 'd3bf813f-cd86-415a-9863-8c84a45d57e8', 'f058f260-9c71-4e08-90c7-cf288e8bb822', '3a9ae927-462c-4fa9-af5b-63393756a5b7'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:26:05 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Delete snapshot completed successfully.
Aug 26 17:26:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-e791f127-437f-40dc-8b43-ef0be5ae9211 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-32926344-b157-47b1-975b-7f8db00c88ef-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-e4e69892-a17e-4755-842f-b8318566accd-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-e4e69892-a17e-4755-842f-b8318566accd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "cinder-quobyte-e4e69892-a17e-4755-842f-b8318566accd" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:05 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-e4e69892-a17e-4755-842f-b8318566accd" acquired by "delete_volume" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:05 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbc1518-7153-4c28-a69f-07070142a0f8]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:26:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:05 devstack sudo[116108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd
Aug 26 17:26:05 devstack sudo[116108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:05 devstack sudo[116108]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd" returned: 0 in 0.384s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:05 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:05 devstack sudo[116113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd
Aug 26 17:26:05 devstack sudo[116113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:06 devstack sudo[116113]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-e4e69892-a17e-4755-842f-b8318566accd" returned: 0 in 0.255s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-quobyte-e4e69892-a17e-4755-842f-b8318566accd" released by "delete_volume" :: held 0.708s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:06 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Created reservations ['d20be6e8-6b0d-4dd8-a348-e4f8b7cbc717', 'dd3f0e97-10d3-4ca1-8738-289a4b9ef287', '2331785b-b181-4f66-8a70-d455600dea3c', '778f9877-1986-4196-95e6-738611822518'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:26:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:26:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:26:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:26:06 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:26:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:26:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:06 devstack sudo[116116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:26:06 devstack sudo[116116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:06 devstack sudo[116116]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:06 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.266s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:06 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:26:06 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Deleted volume successfully.
Aug 26 17:26:06 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-77deb29e-c412-4541-b782-8dc1750da624 tempest-ProjectMemberTests-2141364931 None] Lock "cinder-e4e69892-a17e-4755-842f-b8318566accd-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:16 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=16,cinder:INSERT=10,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:26:16 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=26,cinder:SELECT=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Flow 'volume_create_manager' (dfe0546e-67b7-43bc-b063-acf61fad410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c122f54-421a-45a3-b344-7467f65b2aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c122f54-421a-45a3-b344-7467f65b2aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2059953771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48a46a7-7473-4775-ac5f-4fd76da3eec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063e0cc2aad47ddadd0d246037d0d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:26:36Z,use_quota=True,user_id='834d2146490444c1a63ea689c627d549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c10798-082d-4384-b2fd-253682b18c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c10798-082d-4384-b2fd-253682b18c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f85cd99-5292-4ebc-9c18-42b0c47ddef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f85cd99-5292-4ebc-9c18-42b0c47ddef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd48a46a7-7473-4775-ac5f-4fd76da3eec9', 'volume_name': 'volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4750843-4525-41fa-a9cb-3ab4141c58dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4750843-4525-41fa-a9cb-3ab4141c58dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf248a3-ea42-47c5-8590-811c302182f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:36 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Volume d48a46a7-7473-4775-ac5f-4fd76da3eec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9', 'volume_size': 1}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7901fd84d580>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2059953771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48a46a7-7473-4775-ac5f-4fd76da3eec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063e0cc2aad47ddadd0d246037d0d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:26:36Z,use_quota=True,user_id='834d2146490444c1a63ea689c627d549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)}" {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Creating volume d48a46a7-7473-4775-ac5f-4fd76da3eec9 {{(pid=94125) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:26:36 devstack cinder-volume[94125]: INFO cinder.volume.drivers.remotefs [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] casted to osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 1073741824 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:36 devstack sudo[116167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 1073741824
Aug 26 17:26:36 devstack sudo[116167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:36 devstack sudo[116167]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 1073741824" returned: 0 in 0.395s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:36 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:36 devstack sudo[116173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9
Aug 26 17:26:36 devstack sudo[116173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:37 devstack sudo[116173]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9" returned: 0 in 0.232s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'} {{(pid=94125) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf248a3-ea42-47c5-8590-811c302182f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9', 'volume_size': 1}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72bd957-ed5c-4fec-a304-0950fd4aa0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:37 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Volume volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 (d48a46a7-7473-4775-ac5f-4fd76da3eec9): created successfully
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72bd957-ed5c-4fec-a304-0950fd4aa0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Flow 'volume_create_manager' (dfe0546e-67b7-43bc-b063-acf61fad410f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:26:37 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-642167e3-4b0a-429d-a025-5c199e485b75 tempest-SnapshotDependencyTests-980020296 None] Created volume successfully.
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] Creating offline snapshot 68ddd49f-3f51-4c2c-9235-7e0881af2e99 of volume d48a46a7-7473-4775-ac5f-4fd76da3eec9 {{(pid=94125) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[326434be-37cc-450c-952d-9b1775a029a6]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:37 devstack sudo[116176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9
Aug 26 17:26:37 devstack sudo[116176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:37 devstack sudo[116176]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9" returned: 0 in 0.338s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:37 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99 1G {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:37 devstack sudo[116181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99 1G
Aug 26 17:26:37 devstack sudo[116181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:38 devstack sudo[116181]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99 1G" returned: 0 in 0.362s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:38 devstack sudo[116186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99
Aug 26 17:26:38 devstack sudo[116186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:38 devstack sudo[116186]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 -F qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99" returned: 0 in 0.298s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:38 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99 is being set with open permissions: ugo+rw
Aug 26 17:26:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:38 devstack sudo[116191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99
Aug 26 17:26:38 devstack sudo[116191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:38 devstack sudo[116191]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99" returned: 0 in 0.238s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:38 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:38 devstack sudo[116194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.info
Aug 26 17:26:38 devstack sudo[116194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:39 devstack sudo[116194]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.info" returned: 0 in 0.243s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:39 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.info is being set with open permissions: ugo+rw
Aug 26 17:26:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.info {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:39 devstack sudo[116199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.info
Aug 26 17:26:39 devstack sudo[116199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:39 devstack sudo[116199]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.info" returned: 0 in 0.230s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:39 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.785s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:26:39 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-6c04bce9-068e-4bee-8932-4dc158fbcedf tempest-SnapshotDependencyTests-980020296 None] Create snapshot completed successfully
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94125) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Flow 'volume_create_manager' (cb29f742-968d-4102-9d0f-1dfb5873799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28e8e2d-f745-4f37-a756-0d42650a64f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28e8e2d-f745-4f37-a756-0d42650a64f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T15:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90930502-a404-4cea-ac47-95fe94de6cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e063e0cc2aad47ddadd0d246037d0d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T15:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68ddd49f-3f51-4c2c-9235-7e0881af2e99,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T15:26:40Z,use_quota=True,user_id='834d2146490444c1a63ea689c627d549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43ce97c4-7c8d-4c22-90b8-e74aeff153d9),volume_type_id=43ce97c4-7c8d-4c22-90b8-e74aeff153d9)' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d968ad-ba89-4203-a886-659465736442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d968ad-ba89-4203-a886-659465736442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55245658-404b-45cc-8538-a750e2875846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55245658-404b-45cc-8538-a750e2875846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90930502-a404-4cea-ac47-95fe94de6cc0', 'volume_name': 'volume-90930502-a404-4cea-ac47-95fe94de6cc0', 'volume_size': 1, 'snapshot_id': '68ddd49f-3f51-4c2c-9235-7e0881af2e99'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5494ee-f18d-4436-acaa-3e8b23834e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5494ee-f18d-4436-acaa-3e8b23834e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d029369c-4998-4224-a456-044828fba039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:40 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Volume 90930502-a404-4cea-ac47-95fe94de6cc0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90930502-a404-4cea-ac47-95fe94de6cc0', 'volume_size': 1, 'snapshot_id': '68ddd49f-3f51-4c2c-9235-7e0881af2e99'}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "cinder-quobyte-68ddd49f-3f51-4c2c-9235-7e0881af2e99-90930502-a404-4cea-ac47-95fe94de6cc0" by "_create_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-quobyte-68ddd49f-3f51-4c2c-9235-7e0881af2e99-90930502-a404-4cea-ac47-95fe94de6cc0" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Creating volume 90930502-a404-4cea-ac47-95fe94de6cc0 from snapshot 68ddd49f-3f51-4c2c-9235-7e0881af2e99 {{(pid=94125) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Selected osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401 as target Quobyte volume. {{(pid=94125) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "cinder-quobyte-90930502-a404-4cea-ac47-95fe94de6cc0" by "_copy_volume_from_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-quobyte-90930502-a404-4cea-ac47-95fe94de6cc0" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] snapshot: 68ddd49f-3f51-4c2c-9235-7e0881af2e99, volume: 90930502-a404-4cea-ac47-95fe94de6cc0,  {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[647c7108-336f-47c5-aae8-b3e17b4dda73]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:40 devstack sudo[116202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99
Aug 26 17:26:40 devstack sudo[116202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:40 devstack sudo[116202]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99" returned: 0 in 0.343s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb45a018-7b4b-4dc0-9b4f-c9f8a6183963]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:40 devstack sudo[116207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9
Aug 26 17:26:40 devstack sudo[116207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:40 devstack sudo[116207]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9" returned: 0 in 0.337s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Creating direct copy from snapshot {{(pid=94125) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG cinder.utils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Path /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0 not found in is_blk_device check {{(pid=94125) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 26 17:26:40 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:40 devstack sudo[116212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0
Aug 26 17:26:40 devstack sudo[116212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:26:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:26:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:26:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:26:42 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:26:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:26:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:42 devstack sudo[116225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:26:42 devstack sudo[116225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:42 devstack sudo[116225]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:42 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.530s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:42 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:26:42 devstack cinder-volume[94125]: DEBUG oslo_service.periodic_task [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] Running periodic task VolumeManager._thread_info {{(pid=94125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 17:26:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread count: 29 {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 17:26:42 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9e6cca2-ce62-4875-b146-26536c58ac8e None None] thread info: [<_MainThread(MainThread, started 133049567543424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133049456808704)>, <Thread(Thread-3 (stat_writer), started daemon 133049454138688)>, <Thread(Rabbit-heartbeat, started daemon 133049452851520)>, <Thread(Thread-5 (_runner), started daemon 133049453037952)>, <Thread(Thread-7 (_runner), started daemon 133049453167616)>, <Thread(fd_logger, started daemon 133049451335552)>, <Thread(privsep_reader, started daemon 133049447036864)>, <Thread(tpool_thread_0, started daemon 133049440601792)>, <Thread(tpool_thread_1, started daemon 133049432209088)>, <Thread(tpool_thread_2, started daemon 133049423816384)>, <Thread(tpool_thread_3, started daemon 133049415423680)>, <Thread(tpool_thread_4, started daemon 133049407030976)>, <Thread(tpool_thread_5, started daemon 133049398638272)>, <Thread(tpool_thread_6, started daemon 133049390245568)>, <Thread(tpool_thread_7, started daemon 133049381852864)>, <Thread(tpool_thread_8, started daemon 133049373443776)>, <Thread(tpool_thread_9, started daemon 133049365034688)>, <Thread(tpool_thread_10, started daemon 133049356625600)>, <Thread(tpool_thread_11, started daemon 133049348216512)>, <Thread(tpool_thread_12, started daemon 133049339807424)>, <Thread(tpool_thread_13, started daemon 133049331398336)>, <Thread(tpool_thread_14, started daemon 133049322989248)>, <Thread(tpool_thread_15, started daemon 133049314580160)>, <Thread(tpool_thread_16, started daemon 133049306171072)>, <Thread(tpool_thread_17, started daemon 133049297761984)>, <Thread(tpool_thread_18, started daemon 133049289352896)>, <Thread(tpool_thread_19, started daemon 133049280943808)>, <Thread(Rabbit-heartbeat, started daemon 133049442341056)>] {{(pid=94125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 17:26:44 devstack sudo[116212]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0" returned: 0 in 3.958s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:44 devstack cinder-volume[94125]: DEBUG cinder.image.image_utils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Image conversion details: src /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9, size 1024.00 MB, duration 3.96 sec, destination /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0 {{(pid=94125) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 17:26:44 devstack cinder-volume[94125]: INFO cinder.image.image_utils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Converted 1024.00 MB image at 258.65 MB/s
Aug 26 17:26:44 devstack cinder-volume[94125]: WARNING cinder.volume.drivers.remotefs [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0 is being set with open permissions: ugo+rw
Aug 26 17:26:44 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:44 devstack sudo[116228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0
Aug 26 17:26:44 devstack sudo[116228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:45 devstack sudo[116228]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0" returned: 0 in 0.230s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-quobyte-90930502-a404-4cea-ac47-95fe94de6cc0" released by "_copy_volume_from_snapshot" :: held 4.937s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-quobyte-68ddd49f-3f51-4c2c-9235-7e0881af2e99-90930502-a404-4cea-ac47-95fe94de6cc0" released by "_create_volume_from_snapshot" :: held 4.997s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.010s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d029369c-4998-4224-a456-044828fba039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90930502-a404-4cea-ac47-95fe94de6cc0', 'volume_size': 1, 'snapshot_id': '68ddd49f-3f51-4c2c-9235-7e0881af2e99'}' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e3a381-ccab-482b-bf88-ea4ae4d55e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 17:26:45 devstack cinder-volume[94125]: INFO cinder.volume.flows.manager.create_volume [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Volume volume-90930502-a404-4cea-ac47-95fe94de6cc0 (90930502-a404-4cea-ac47-95fe94de6cc0): created successfully
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e3a381-ccab-482b-bf88-ea4ae4d55e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94125) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Flow 'volume_create_manager' (cb29f742-968d-4102-9d0f-1dfb5873799f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94125) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 17:26:45 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-b9ceccfe-c3a1-4c4c-9f75-cb28585c861c tempest-SnapshotDependencyTests-980020296 None] Created volume successfully.
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "cinder-68ddd49f-3f51-4c2c-9235-7e0881af2e99-delete_snapshot" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-68ddd49f-3f51-4c2c-9235-7e0881af2e99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "cinder-quobyte-d48a46a7-7473-4775-ac5f-4fd76da3eec9" by "delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-quobyte-d48a46a7-7473-4775-ac5f-4fd76da3eec9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "cinder-quobyte-68ddd49f-3f51-4c2c-9235-7e0881af2e99" by "_delete_snapshot" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-quobyte-68ddd49f-3f51-4c2c-9235-7e0881af2e99" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Deleting offline snapshot 68ddd49f-3f51-4c2c-9235-7e0881af2e99 of volume d48a46a7-7473-4775-ac5f-4fd76da3eec9 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] snapshot_file for this snap is: volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99 {{(pid=94125) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[593b5ee1-166e-4c97-aded-27e3be61375d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:26:45 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:45 devstack sudo[116231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99
Aug 26 17:26:45 devstack sudo[116231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:46 devstack sudo[116231]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99" returned: 0 in 0.335s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:46 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.remotefs [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94125) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 17:26:46 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3dff6c-5bb1-44ce-97cc-65d1d5becf7b]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:26:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:46 devstack sudo[116236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9
Aug 26 17:26:46 devstack sudo[116236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:46 devstack sudo[116236]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9" returned: 0 in 0.515s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:46 devstack sudo[116241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99
Aug 26 17:26:46 devstack sudo[116241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:46 devstack sudo[116241]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99" returned: 0 in 0.308s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:46 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:46 devstack sudo[116248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99
Aug 26 17:26:46 devstack sudo[116248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:47 devstack sudo[116248]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9.68ddd49f-3f51-4c2c-9235-7e0881af2e99" returned: 0 in 0.226s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-quobyte-68ddd49f-3f51-4c2c-9235-7e0881af2e99" released by "_delete_snapshot" :: held 1.473s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-quobyte-d48a46a7-7473-4775-ac5f-4fd76da3eec9" released by "delete_snapshot" :: held 1.494s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:47 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Created reservations ['379efc43-3682-4166-9363-f2990fa25575', 'd5ba8b45-e892-4b60-ab09-83cde223c3f2', '802d36d0-fc34-4f49-88b3-5c139d01fd7d', '6e8a79cc-1c62-4529-bea1-64ba6b830f1c'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:26:47 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Delete snapshot completed successfully.
Aug 26 17:26:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-771663af-85f4-454d-a2b5-764adeda82a4 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-68ddd49f-3f51-4c2c-9235-7e0881af2e99-delete_snapshot" released by "delete_snapshot" :: held 1.617s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "cinder-d48a46a7-7473-4775-ac5f-4fd76da3eec9-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-d48a46a7-7473-4775-ac5f-4fd76da3eec9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "cinder-quobyte-d48a46a7-7473-4775-ac5f-4fd76da3eec9" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:47 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-quobyte-d48a46a7-7473-4775-ac5f-4fd76da3eec9" acquired by "delete_volume" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:47 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[6480284d-6562-41a2-a6d8-52062d71a14d]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:26:47 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:47 devstack sudo[116251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9
Aug 26 17:26:47 devstack sudo[116251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:48 devstack sudo[116251]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9" returned: 0 in 0.334s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:48 devstack sudo[116256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9
Aug 26 17:26:48 devstack sudo[116256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:48 devstack sudo[116256]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-d48a46a7-7473-4775-ac5f-4fd76da3eec9" returned: 0 in 0.240s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-quobyte-d48a46a7-7473-4775-ac5f-4fd76da3eec9" released by "delete_volume" :: held 0.627s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Created reservations ['0a435b65-c2ea-42de-a80d-0be281847970', '855b3f77-e346-4ddc-af72-2fb20185e25f', '5b4b09bc-4f2c-4ab7-ba09-626e04919add', 'b6c7c74d-5ec6-4e2d-9ce3-a5477623450f'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:48 devstack sudo[116259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:26:48 devstack sudo[116259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:48 devstack sudo[116259]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.230s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:26:48 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Deleted volume successfully.
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-315f8be0-a6e3-4723-aab1-a22672303ee7 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-d48a46a7-7473-4775-ac5f-4fd76da3eec9-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "cinder-90930502-a404-4cea-ac47-95fe94de6cc0-delete_volume" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-90930502-a404-4cea-ac47-95fe94de6cc0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:48 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "cinder-quobyte-90930502-a404-4cea-ac47-95fe94de6cc0" by "delete_volume" {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-quobyte-90930502-a404-4cea-ac47-95fe94de6cc0" acquired by "delete_volume" :: waited 0.013s {{(pid=94125) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51891b0-8bc1-4685-a0db-c6c190e3d1b3]: (4, 'qcow2') {{(pid=96023) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:49 devstack sudo[116262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0
Aug 26 17:26:49 devstack sudo[116262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:49 devstack sudo[116262]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0" returned: 0 in 0.361s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:49 devstack sudo[116267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0
Aug 26 17:26:49 devstack sudo[116267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:49 devstack sudo[116267]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65/volume-90930502-a404-4cea-ac47-95fe94de6cc0" returned: 0 in 0.245s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-quobyte-90930502-a404-4cea-ac47-95fe94de6cc0" released by "delete_volume" :: held 0.646s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG cinder.quota [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Created reservations ['327c3655-ad4f-4903-bdd2-8651ad16ad48', '735a4bbc-dbfd-4700-8838-28fc8cfcbb8a', '72c708db-4dab-47aa-8e0d-d5b80e3ad5d6', '0e8f0437-015e-4c01-9161-6308cda757f7'] {{(pid=94125) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401': None} {{(pid=94125) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG cinder.volume.drivers.quobyte [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b059564d-a9f0-4f7a-876d-85ec99235401'] {{(pid=94125) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.lockutils [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94125) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 17:26:49 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65 {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 17:26:49 devstack sudo[116270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65
Aug 26 17:26:49 devstack sudo[116270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 17:26:50 devstack sudo[116270]: pam_unix(sudo:session): session closed for user root
Aug 26 17:26:50 devstack cinder-volume[94125]: DEBUG oslo_concurrency.processutils [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e40a8c39f4923087b950165881a8ce65" returned: 0 in 0.242s {{(pid=94125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 17:26:50 devstack cinder-volume[94125]: DEBUG cinder.manager [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Notifying Schedulers of capabilities ... {{(pid=94125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 17:26:50 devstack cinder-volume[94125]: INFO cinder.volume.manager [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Deleted volume successfully.
Aug 26 17:26:50 devstack cinder-volume[94125]: DEBUG cinder.coordination [None req-7b94ea0b-59c6-42de-b597-239334e2f498 tempest-SnapshotDependencyTests-980020296 None] Lock "cinder-90930502-a404-4cea-ac47-95fe94de6cc0-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=94125) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 17:26:59 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:SELECT=27,cinder:INSERT=6,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 17:27:00 devstack cinder-volume[94125]: DEBUG dbcounter [-] [94125] Writing DB stats cinder:UPDATE=29,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=9 {{(pid=94125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}